Reflexive Concepts is seeking a skilled Software Engineer III to join our team!
In this role, the engineer will leverage extensive expertise in dataflow design, data transport mechanisms, and Apache Spark-based distributed processing to design, implement, and optimize data ingress/egress pathways, ensuring efficient, scalable, and reliable processing of the organization's analytics workloads.
Qualifications:
- Active TS/SCI + FS Polygraph
- Master's degree in Computer Science or related discipline from an accredited college or university, plus 5 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
- Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus 7 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
- 9 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
Required Skills + Experience:
- Experience using the Linux CLI and Linux tools
- Experience developing Bash scripts to automate manual processes
- Recent software development experience using Python and Java
- Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
- Experience with Distributed Big Data processing engines including Apache Spark
- Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
- Experience using Jupyter Notebook
- Experience with data wrangling and preprocessing using tools such as pandas, NumPy
- Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
- Familiarity with data quality concepts, data validation, and anomaly detection
- Experience with Git Source Control System
Desired Skills + Experience
- Familiar with HPC Job Scheduling tools including Slurm
- Experience using the Atlassian Tool Suite (JIRA, Confluence)