Data Engineer Technical Skills

Data Engineer:

“Data engineers are the ones that take the messy data and build the infrastructure for real, tangible analysis. They run ETL software, marry data sets, enrich and clean all that data that companies have been storing for years”.

Technical Skills Required for Data Engineer:

• A bachelor’s degree required in computer science engineering/software engineering
• Database architectures
• Statistical analysis and modelling
• Hadoop-based technologies such as MapReduce, Hive and Pig
• SQL-based technologies such as PostgreSQL and MySQL
• NoSQl technologies such as MongoDB and Cassandra
• Data modelling tools such as ERWin, Enterprise Architect and Visio
• Python, C, C++, Java, Perl
• MatLab, SAS, R
• Predictive modelling, NLP and text analysis
• Machine learning
• Data mining
• Data warehousing solutions