Career Opportunities with TechTarget

A great place to work.

 
Share with friends!

 

 
 

Principal Data Engineer

Department: Product Development
Location: Newton, MA, United States

Since the beginning, TechTarget’s problem-solving content has risen to the top of enterprise tech buyers’ Google searches. Today it spans more than 10,000 specific topics. Our readers’ content consumption patterns provide the raw material for unique insights into their business needs. And because they find value in what we publish, they give us permission to share the data with our vendor clients.

Through two decades of optimization, we’ve learned how to grow buyer interest and influence purchase decisions. We’ve got fingers on the pulse of over 200 target markets, and since we have first-hand knowledge about tech marketing and sales, we can provide the best available guidance for practitioners around the globe.

The Principal Data Engineer / Lead will play a key role in in the Design and Development of Data models, datasets, and ETL/ELT pipelines from a variety of data sources to the Data Warehouse / Data Lake on Google Cloud Platform (GCP) for TechTarget’s flagship Priority Engine product.  Priority Engine relies heavily on this foundational data layer.

The Principal Data Engineer will help provide technical leadership and strategic direction for Priority Engine’s data platform. The position will be responsible for the delivery and technical quality of our programs, taking on complex projects. It will also partner with cross-functional stakeholders to drive initiatives forward, and mentor team members in technical design, project leadership, and running team processes. The position will be responsible to build and maintain scalable data infrastructure

The candidate must have a keen sense for the business drivers, have a vision for the data strategy and help execute it. The candidate must be familiar with industry trends and best practices around data engineering on the cloud and apply them appropriately.

Role / Responsibilities:

  • Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in Google Cloud Platform (GCP);
  • Create ETL/ELT pipelines that transform and process terabytes of structured and unstructured data in real-time;
  • Design data models for optimal storage and retrieval to support sub-second latency;
  • Deploy and monitor large database clusters that are performant and highly available;
  • Deeply immerse in our Priority Engine Data Pipelines, to acquire full understanding and ability to converse with business representatives and individual contributors alike; and
  • Incorporate solid understanding of cloud-based offerings in the space.
  • Some upcoming technical challenges include scaling our data ingestion pipelines across a growing number of GCP, AWS, and data center-based data sources, reducing the latency of our product data ingestion pipelines through moving batch jobs into a streaming architecture, and extending our data lake architecture for the growing ecosystem of data ingestion and creation tools.
  • Be a hands-on contributor on the team;
  • Collaborate with product/application architects to develop holistic solutions;
  • Implement operational procedures (logging, monitoring, alerting, etc.) for dependable running of pipelines/jobs; and
  • Be autonomous. You own what you work on. You move fast, take ownership, and get things done. The Data lake/warehouse is a central and essential service for multiple initiatives, and you need to be able to multitask and juggle priorities on a regular basis with a deep understanding of business impacts of prioritization decisions.

 

Skills/Requirements:

  • BS Degree in Computer Science or a related field,
  • 10+ years industry experience, 5+ years of experience building real-time and distributed system architecture, from whiteboard to production,
  • Strong programming skills in Python and SQL,
  • Versatility: 8+ years’ experience across the entire spectrum of data engineering, including:
    • Cloud data stores (Example: GCP BigQuery, GCP BigTable, GCP FireStore, GCP CloudSQL, ELK)
    • Data pipeline and workflow orchestration tools (e.g., Dataflow, Pentaho, Airflow, Azkaban)
    • Data processing technologies (e.g., GCP BigQuery, Spark)
    • Data messaging technologies (e.g., GCP PubSub, Kafka)
    • Deployment and monitoring large database clusters in public cloud platforms (e.g., Docker, Terraform),
  • Unix/Linux Shell scripting,
  • Demonstrated knowledge of industry trends and standards,
  • Ability to think through multiple alternatives and select the best possible solutions for strategic and tactical business needs, and
  • Excellent communication. You will need communicate complex ideas effectively to both technical and non-technical audiences, and both verbally and in writing.
  • This role can be done remotely (LI#_Remote)

 

Nice to Have:

  • Experience with GCP
  • Java Programming

Join us:

We’re a great company aspiring to even greater heights. It’s a terrific place to get your start and a fantastic company to accelerate your career. If you aspire to be a part of something special and join a team where your contribution can make a measurable difference, please apply and we look forward to reviewing your resume.

TechTarget (https://www.techtarget.com/ ) offers generous benefits including Health, Dental, Vision and 401k plans. We also have an Open Leave Policy and 18 paid holidays!

TechTarget, Inc. is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. TechTarget strictly prohibits and does not tolerate discrimination against employees, applicants, or any other covered persons because of race, color, sex (including pregnancy), age, national origin or ancestry, ethnicity, religion, creed, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, training, promotion, discipline, compensation, benefits, and termination of employment. TechTarget complies with the Americans with Disabilities Act (ADA), as amended by the ADA Amendments Act, and all applicable state or local law.

Please view our Privacy Policy for more information to know more about how we collect, use and transfer the personal data of our candidates.

 

 

 

Applicant Tracking System Powered by ClearCompany HRM Applicant Tracking System