Noggin
Country : Singapore
  • Full-time
  • Part-time
  • Freelance
  • Temporary
  • Co-founder
  • Contract

Data Engineer at Noggin

Noggin is in the business of helping individuals manage and monetize their data, which is stored on containerized Private Data Stores. Users monetize their data by (i) viewing advertisements that are matched to them, and (ii) contributing to data aggregation queries/statistical learning processes that they authorize.

Responsibilities

Job Description

We are looking for a Data Engineer with a strong background in building and maintaining data processing pipelines, and who is enthusiastic about "privacy-by-design" data mining and processing.

Classical data engineering capabilities are expected. In particular, proficiency in Apache Spark and associated tools.

 

Responsibilities

  • Selection and integration of "Big Data" tools and frameworks
  • Performance monitoring and maintenance of data infrastructure
  • Collaboration on the design and development of privacy-by-design data processing solutions

Requirements

Required Skills

  • Solid understanding of distributed computing principles
  • Proficiency working with distributed data sources
  • Experience setting up and managing Spark clusters (preferably on Amazon Web Services)
  • Experience building Spark data processing pipelines

 

Additional Skills

  • Experience with Scala and AWS Lambda would be an advantage (we use both)
  • Experience with components of the broader Spark eco-system would be an advantage
  • Experience with messaging systems (e.g.: Kafka, RabbitMQ) would be an advantage
  • Experience with configuration management tools (e.g.: Salt, Terraform) would be an advantage

Salary

5000 - 7500 SGD

Total applicants :9 Job posted 7 days ago Total Views : 172 Unique Views : 171 Today Views : 16


Submit Application