Core4ce has an opportunity with a mission critical IC Sponsor for a Sr. Data Engineer Position. This Sponsor organization plays a significant role in the highly optimized mission-ready data conditioning and delivery systems in support of mission analytics. A Full Scope Polygraph is required for this position, no exceptions. 

The ideal candidate supports critical mission objectives in near real-time - designing, engineering, and maintaining systems that accept raw streaming data feeds from a wide variety of sources. Because raw content itself is of nominal use to the mission, candidates are entrusted by the mission to build processes that extract, transform, and load data into downstream applications. These downstream applications are vital to the mission. But their value is compromised without continuous data updates. Candidates keep the data flowing to mission users, 24x7. Interested candidates will also develop dashboards and automated alerting mechanisms to monitor data feeds. Mission success depends on flagging data flow failures and restoring data to mission users and systems, with maximum urgency and minimal delay. 

Responsibilities

Candidate will design and develop complex new software products or make significant enhancements to existing software. The ideal candidate is a hands-on developer with significant experience in building modular, reusable services and features.  Candidate must have expertise in a modern service-oriented architecture and must be familiar with working on an Agile team environment with little to no supervision.  Successful candidates embody a passion for continuous improvement and innovation.

Requirements

• Full Scope Polygraph 
• Experienced with Apache NiFi and IC equivalent.
• General understanding and ability to work with zookeeper.
• Expert level experience developing data ETL processes.
• Able to deploy and maintain NiFi clusters.
• 5+ years experience with a variety of scripting languages including bash, Python, and Groovy.
• Experienced using EC2 instances in AWS.
• 2-5 years of experience working with Ansible, developing playbooks and roles for software driven deployment of nifi clusters and zookeeper clusters.
• Understanding of Git and Gitlab.
• 2-5 years’ experience using REST APIs to call RESTful services.
• Familiar with Linux – particularly the new Rocky variant (customer will soon be migrating to that from CentOS and other variants).
• Working level familiarity with Elasticsearch and kibana. Able to develop dashboard visualizations in kibana from data in elasticsearch.

All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.