rzmk/de-intern-guide
1
0
Fork 0
mirror of https://github.com/dathere/de-intern-guide.git synced 2025-12-19 08:39:25 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

🎉 Initial file upload!

Browse source
This commit is contained in:
rzmk 2023-06-05 17:57:16 -04:00
commit a7bd657561
No known key found for this signature in database
29 changed files with 22290 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

32
docs/intro.mdx Normal file
View file

@ -0,0 +1,32 @@
---
slug: /
sidebar_position: 1
---
# 👋 Welcome to datHere!
<a href="https://dathere.com" target="_blank">
<video
width="100%"
src="/vid/datHere-logo-intro.mp4"
autoPlay
loop
muted
></video>
</a>
## ✨ Overview
Glad to have you here 🎉! This guide serves as a reference guide for new data engineering interns at [datHere](https://dathere.com/).
If you have any more questions that aren't answered here, please reach out to your team members on Slack.
## ⚡ Quick Links!
- [datHere Website 🌐](https://dathere.com/)
- [datHere GitHub 🖥](https://github.com/dathere)
- [datHere LinkedIn 👔](https://www.linkedin.com/company/dathere/)
## 🔍 Found a Mistake? Outdated Guide?
Feel free to contribute to this site by clicking the "Edit this page" button at the bottom of any page to make a PR on our GitHub repo.

8
docs/onboarding/_category_.json Normal file
View file

@ -0,0 +1,8 @@
{
"label": "🌱 Onboarding Setup",
"position": 1,
"link": {
"type": "generated-index",
"description": "Installation instructions to setting up your workspace with the necessary software and tools."
}
}

18
docs/onboarding/ckan-setup.mdx Normal file
View file

@ -0,0 +1,18 @@
---
sidebar_position: 4
---
# 📊 CKAN Setup
In this section we'll go over how to install [CKAN](https://ckan.org) and get it running on your Ubuntu VM.
## 📺 Video Tutorial
import LiteYouTubeEmbed from "react-lite-youtube-embed";
import "react-lite-youtube-embed/dist/LiteYouTubeEmbed.css";
<LiteYouTubeEmbed id="" />
### Video Resources
## 📝 Written Tutorial

18
docs/onboarding/datapusher-plus-setup.mdx Normal file
View file

@ -0,0 +1,18 @@
---
sidebar_position: 5
---
# 📮 DataPusher+ Setup
In this section we'll go over how to install [DataPusher+ with Docker](https://github.com/dathere/datapusher-plus-docker) and using it with CKAN.
## 📺 Video Tutorial
import LiteYouTubeEmbed from "react-lite-youtube-embed";
import "react-lite-youtube-embed/dist/LiteYouTubeEmbed.css";
<LiteYouTubeEmbed id="" />
### Video Resources
## 📝 Written Tutorial

18
docs/onboarding/qsv-setup.mdx Normal file
View file

@ -0,0 +1,18 @@
---
sidebar_position: 3
---
# ⚡ qsv Setup
In this section we'll go over how to install [qsv](https://github.com/jqnatividad/qsv) and get it running on your Ubuntu VM.
## 📺 Video Tutorial
import LiteYouTubeEmbed from "react-lite-youtube-embed";
import "react-lite-youtube-embed/dist/LiteYouTubeEmbed.css";
<LiteYouTubeEmbed id="" />
### Video Resources
## 📝 Written Tutorial

21
docs/onboarding/setup-overview.mdx Normal file
View file

@ -0,0 +1,21 @@
---
sidebar_position: 1
---
# 🗺 Setup Overview
Before you start diving into awesome projects and working with your team, you'll need the right equipment 🛠💼.
Refer to the upcoming sections to help you install everything. For now, let's take a look at the cool tools you'll be setting up 🤘!
## 😎 Cool Tools!
| Software/Tool | Description |
| ---------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [VirtualBox](https://www.virtualbox.org/) | VirtualBox is a virtualization software that allows you to run a virtual machine on your computer. Simply put, this program lets you have virtual computers inside your computer! |
| [Ubuntu](https://ubuntu.com/) | Ubuntu is a free and open-source operating system. It is a Linux distribution and is often useful for running on virtual machines. |
| [qsv](https://github.com/jqnatividad/qsv) | qsv (pronounced "Quicksilver") is a command line program for indexing, slicing, analyzing, filtering, enriching, validating & joining CSV files. Commands are simple, fast & composable. |
| [CKAN](https://ckan.org) | CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share, and use data. It powers hundreds of data portals worldwide. |
| [DataPusher+ with Docker](https://github.com/dathere/datapusher-plus-docker) | [DataPusher+](https://github.com/dathere/datapusher-plus) is standalone web service that pushes data into the CKAN DataStore fast & reliably. We'll be setting up a containerized version of DataPusher+ by using [Docker](https://www.docker.com/). |
## 🧩 Putting It All Together

31
docs/onboarding/ubuntu-vm-setup.mdx Normal file
View file

@ -0,0 +1,31 @@
---
sidebar_position: 2
---
# 💻 Ubuntu VM Setup
In this section we'll go over how to install [VirtualBox](https://www.virtualbox.org/) and run [Ubuntu](https://ubuntu.com/) 22.04.2 LTS on a virtual machine.
## 📺 Video Tutorial
import LiteYouTubeEmbed from "react-lite-youtube-embed";
import "react-lite-youtube-embed/dist/LiteYouTubeEmbed.css";
<LiteYouTubeEmbed id="" />
### Video Resources
- [VirtualBox Downloads Page](https://www.virtualbox.org/wiki/Downloads)
- [Ubuntu Desktop Download Page](https://ubuntu.com/download/desktop)
## 📝 Written Tutorial
### 📥 Download VirtualBox
### 🛠 Install VirtualBox
### 📥 Download Ubuntu 22.04.2 LTS
### 🖥 Setup a Virtual Machine (VM)
### ✨ Bonus Tips

7
docs/qsv-whirlwind-tour.md Normal file
View file

@ -0,0 +1,7 @@
---
sidebar_position: 3
---
# 🌪 qsv Whirlwind Tour
## 📺 Video Demo