Getting Started
The Data Team works across Majority and Rebtel. This page is the onboarding path. Your manager assigns you a buddy who guides you through it.
Track Your Progress
Your manager creates an onboarding project in Linear with one issue per step below. You own the project and your buddy reviews it.
Manager Checklist
On day 1:
- Buddy assigned
- Onboarding project and issues created in
Linear - First-week meetings booked: buddy intro and team rituals
- Company accesses granted, see Majority or Rebtel
- Invited to the Slack channels, the
Datateam inLinearand theGitHuborg
1. Shared Setup
- Company email and Google account set up
- Added to the
Datateam inLinear - Joined the Slack channels in Communication & Planning
- Tools installed, see Development Environment
- Terminal set up, see CLI Tools
- Anything out of date in these docs fixed as you go
2. Company Setup
- Microsoft account for
Azureaccess - Access requests submitted, see Initial Accesses
dbtset up, see dbt SetupDataGripconnected toBigQuery, see Development EnvironmentLookerbasics learned with the Looker intro- Onboarding topics covered, see Onboarding Topics
- Collaboration tools and platform accesses requested, see Initial Accesses
Snowflakeuser createddbtconnected toSnowflake, see Setup- Onboarding topics covered, see Onboarding Topics
3. Data Engineer Levels
Clear one level at a time. Each level ends with a "done when" check, and each one is an issue in your onboarding project. From Level 4, your buddy picks a real ticket for each level, e.g. updating DAGs to a new credential or adding a new ingestion source.
Level 1: Get Oriented
- Read the architecture overview: Majority or Rebtel
- Cover the Onboarding Topics: Majority or Rebtel
- Look at the
dbtproject: Majority dbt or Rebtel dbt project structure - Follow a key model from its source through the intermediate models to the final model, with your buddy
Done when
You can explain how data gets from a source to a dashboard.
Level 2: Update the Docs
- Fix or improve something in these docs that was missing or wrong for you, and take it through the PR flow, see GitHub & Version Control
Done when
Your docs PR is merged.
Level 3: First Model
- Run a
dbtmodel in your dev environment, see Majority dbt or Rebtel dbt development process - Check the output in the warehouse
Done when
You can show the model's output in your dev schema.
Level 4: Pipelines
- Majority: read and trigger an
AirflowDAG, see Airflow, and read File Ingestion - Rebtel: find a source's
LambdainAWSand its logs
Done when
You have found a pipeline run and its logs, and can say what it loads.
Level 5: Infrastructure
- Majority: walk through
dt-gcp-infrastructurewith your buddy, see Infrastructure as Code - Rebtel: walk through the
AWSaccount with your buddy, see AWS
Done when
You can point to where a table or Lambda you know is defined.
Level 6: Ship It
- Pick a minor
dbtchange and take it through the full PR flow, see GitHub & Version Control - Meet the stakeholders of your first tasks
Done when
Your first dbt PR is merged.
Level 7: Own It
- Join the support rotation and handle requests in your company's data team Slack channel
- Take ownership of a domain or pipeline with your buddy's help
Done when
You have shipped a change in the area you own.
4. Analyst Levels
Clear one level at a time, like the Data Engineer levels.
Level 1: Query the Warehouse
- Query
BigQueryfromDataGrip, see BigQuery - Learn the key domains, see Onboarding Topics
- Query
Snowflake, see Snowflake - Learn the key terms and metrics, see Acronyms and Definitions
Done when
You can answer a stakeholder question with a query.
Level 2: Explore
Done when
You can find the Explore behind a dashboard you use.
Level 3: Ship a Report
- Build a first
Lookerlook with your buddy and share it with the team
Done when
A stakeholder is using your report.
Need Help?
- Check the relevant documentation section
- Ask in your company's data team Slack channel (see Communication & Planning)
- Reach out to your buddy, manager or team members