Index.html

<h2 id="about-this-site">About This Site</h2>
<p>Welcome to the official <a href="https://www.reddit.com/r/dataengineering">data engineering</a> wiki! This page contains a quick index to help you find the things you may be interested in. You can also contribute to the site on <a href="https://github.com/JPHaus/data-engineering-wiki">GitHub</a>.</p>
<h2 id="data-engineering">Data Engineering</h2>
<h3 id="frequently-asked-questions">Frequently Asked Questions</h3>
<ul>
<li>[[What is Data Engineering|What is data engineering?]]</li>
<li>[[What is the difference between a Data Engineer and X|What&#39;s the difference between a data engineer and X?]]</li>
<li>[[What skills do I need to become a Data Engineer|What skills do I need to become a Data Engineer?]]</li>
<li>[[What are the best resources for learning about Data Engineering|What are the best resources for learning about Data Engineering?]]</li>
</ul>
<h3 id="getting-started">Getting Started</h3>
<h4 id="core-tools">Core Tools</h4>
<ul>
<li>Learn [[SQL]], the most widely used language for interacting with data.</li>
<li>Learn a scripting language like [[Python]], [[Java]], or [[Scala]] which are currently the most popular languages for DE.</li>
<li>Learn how to use a set of cloud tools like [[Amazon Web Services]], [[Microsoft Azure]], or [[Google Cloud Platform]].</li>
</ul>
<h4 id="core-concepts">Core Concepts</h4>
<ul>
<li>How to build a [[Data Pipeline|data pipeline]].</li>
<li>[[Data Modeling]].</li>
<li>[[Batch Data Processing|Batch]] vs [[Stream Data Processing|Stream processing]].</li>
<li>[[Indexing]].</li>
<li>[[Relational Database|Relational]] vs [[Non-relational Database|Non-relational]] data.</li>
<li>[[Online Transaction Processing|OLTP]] vs [[Online Analytical Processing|OLAP]].</li>
</ul>
<h3 id="advanced-topics">Advanced Topics</h3>
<ul>
<li>[[Data Unit Test|Data Quality]].</li>
<li>[[Data Governance]].</li>
</ul>