Senior Data Engineer

JOB SUMMARY

B-Stock is actively seeking a skilled Senior Data Engineering Developer to spearhead the design, development, scaling, and maintenance of our cutting-edge SaaS infrastructure. In this pivotal role, you will collaborate closely with cross-functional teams encompassing Data Science, Engineering, and Product/Business Technology. Your primary mission will be to construct robust data infrastructure, establish streamlined processes, and enhance our toolset.

ESSENTIAL JOB DUTIES AND RESPONSIBILITIES

Pioneering the vision for Business Intelligence (BI) and Data Warehousing, steering the strategic plan to fruition. Assembling a high-caliber BI and Data Warehouse team, fostering their growth and skill development. Cultivating collaborative relationships with Product Managers, Analysts, and Software Engineers to decipher data requirements and deliver impactful solutions. Architecting, constructing, overseeing, and optimizing foundational data infrastructure. Implementing a monitoring infrastructure to provide real-time insights into the status of our data pipelines. Implementing and supervising processes that enhance implemented solution performance. Optimizing schemas, including partitions, compression, and distribution, to balance costs and performance. Crafting bespoke data infrastructure solutions not readily available off-the-shelf. Creating and sustaining custom data ingestion pipelines and seamless integrations with third-party platforms. Championing Data Quality and the creation of high-impact dashboards. Defining and managing Service Level Agreements (SLAs) for all production datasets and processes. Providing guidance and support to our data team, assisting with design decisions and performance optimization strategies.

MINIMUM QUALIFICATIONS, JOB SKILLS, ABILITIES

EDUCATION:

Bachelor's degree in a technical and/or quantitative field of study—e.g., computer science, mathematics, physics, statistics, or equivalent and/or substantial related experience.

EXPERIENCE:

A remarkable track record of 8+ years in the realm of distributed data technologies. Demonstrable experience in ETL and ELT in cloud SaaS/PaaS infrastructures. Proficiency in serverless Microservices like GCP Cloud Function, AWS Lambda. Hands-on experience on streaming and batch data pipeline. Expertise in databases such as Bigquery, MS SQL on data/domain architecture. Expertise in SQL language to be able to transform raw source data into SQL columns. Experience with GCP solutions such as DataFlow and Pubsub are huge plus. Understanding and experience in AI/ML platform and pipeline, such as Vertext AI.

EMPLOYEE BENEFITS

Competitive compensation packages including bonus and options Medical, dental, and vision benefits Matching 401(K) Paid time off Telecommuting and remote-work options Support for continuing education Team off-sites, social events, annual company events, and frequent extracurricular activities Unlimited snacks and drinks