Industry: Information Technology - Data Architect/Analyst/Administrator
Type: Full Time
$88,940.00 - 130,620.00
Genuent is hiring a Lead/Senior Data Engineer. This would be a direct hire opportunity located in Houston, TX and there is relocation package offered for non-local candidates. If this is something you might be interested in, please send your updated resume to Mike Sabo: ...@genuent.com
US Citizens, Green Card holders and all other parties authorized to work in the US are encouraged to apply. We are unable to provide H1 visa sponsorship at this time.
The overall goal of the Data Engineer is to develop and maintain a data infrastructure for data analytics. Under minimal supervision, this role will be responsible for expanding and optimizing our data, data pipelines, and data services architecture while providing technical leadership in delivering data-intensive solutions.
Implement data flows connecting operational systems, BI systems, and the Big Data platform.
Automate manual data flows for repeated use and scalability.
Develop data-intensive applications with API's and streaming data pipelines.
Prepare and transform data into a usable state for analytics.
Document and maintain source-to-target mappings and data lineage.
Install, configure, and administer Hadoop ecosystem tools and technologies.
Assists Data Scientists in operationalizing and monitoring machine learning models.
Assists Data Analysts and Data Scientists with query optimization, performance tuning, and data processing.
2 years of Lead experience nice to have.
5+ years of functional programming experience in Python and/or Scala.
5+ years of distributed computing experience with Spark and/or Map Reduce.
3+ years of experience developing SQL-based applications.
3+ years of experience developing ETL data pipelines.
3+ years of system administration on Linux systems.
2+ years of experience with multiple Big Data storage tools such as MapR-DB, HBase, MapR-FS, HDFS, Parquet, Avro, and ORC.
Experience in software development life-cycle including change management and testing.
Associated topics: data analyst, data architect, data center, data integrity, data scientist, data warehousing, etl, erp, mongo database, sybase