Senior Data Engineer

  • Remote
  • Full Time
  • Experienced

MayStreet has an immediate opening for a Senior Data Engineer. This is a full-time remote position. We are looking for a passionate and enthusiastic problem-solver with an interest in capital markets data to join us as we continue providing technology innovation and support to the world’s leading global capital markets companies. 

In this role, you will work alongside a talented and open-minded data team that works on mission-critical applications within capital markets technology. You will have the opportunity to contribute in all phases of the development lifecycle – from suggesting the use of emerging technologies to designing, integrating, and upgrading complex architecture.

Who we are

MayStreet is a global software company Headquartered in New York City, servicing the world’s top capital markets trading companies. We’re building the next generation of capital markets technology. Global capital markets are an ocean of fast-moving, interrelated and complex data. Historically it’s been nearly impossible for all but a select few firms to make use of much of this data. MayStreet solves this problem by managing collection, storage and API access to uniquely high-quality data sets. 

Current strategic pursuits

The Senior Data Engineer will be responsible for MayStreet's data processing pipelines. MayStreet has the mission of "Capturing, Storing and Transforming" the world's market data.  Our data team manages the data pipelines that flow between each of those stages. The role has a large operational component while also requiring someone to envision future growth in both utilization and technology selection for the components of the work.

Work qualifications

  • Significant experience with Python. Ability to write and maintain object-oriented Python applications is a must.
  • The ideal candidate will have at least 4+ years of relevant experience
  • Experience with processing job management – experience using one or more of the following: Jenkins, Rundeck, Apache Airflow or other task scheduling software
  • Time spent working in a batch data processing environment or other environment where large data jobs are performed using automation
  • Experience with ETL pipelines and Data Lakes
  • Git version control systems - GitLab and/or GitHub
  • Strong proficiency with Linux and an understanding of Linux server architecture and operation.  Should be very comfortable with data copying, scheduling tasks and Linux daemons

Nice to haves, but not required

  • C/C++ programming experience
  • Experience with AWS data warehouse, Redshift, Athena, Dremio or Snowflake
  • Experience with Google Cloud BigQuery
  • Experience with and knowledge of US and International market data
  • Experience with multicast market data
  • Experience with monitoring and visualization systems such as Nagios, Prometheus and Grafana
  • Experience with time series databases
  • Experience with AWS S3
  • Experience with Docker and Kubernetes

MayStreet perks

  • Competitive compensation 
  • Company paid medical, dental and vision insurance package
  • 401K with matching
  • Generous personal-time-off package 
  • Entrepreneurial environment 
  • Small team with growth opportunity
  • Exposure to all aspects of the financial technology services industry

MayStreet is an equal opportunity employer.


Read More

Apply for this position

Apply with Indeed
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*