Big Data Engineer

Nominet
Full time python java cassandra apache-spark nosql
Software Development
United Kingdom
Hiring from: United Kingdom

About this job


Location options: Remote
Job type: Full-time
Experience level: Mid-Level
Industry: Cybersecurity, DNS, Internet Infrastructure
Company size: 201–500 people
Company type: Private



Technologies

python, java, cassandra, apache-spark, nosql



Job description

MAIN JOB PURPOSE


As Big Data Engineer in our Cyber Security team you will help build and deliver our Big Data Threat Intelligence platform. You will have a focus on data processing, data security and deliver the systems that process huge volumes of data from various sources.


You will be working closely with our Data Scientists, Researchers and Product Development team helping with the development of the data processing pipelines that feed our Threat Intelligence Platform and our Customer Reporting Dashboards. You will be a self motivated learner, willing and able to integrate new technologies and ways of working.


 JOB SUMMARY



  • Development of Nominet’s Threat Intelligence Platform

  • Maintenance and design of data pipelines 

  • Integration of new security data sources

  • Implementation of continuous integration and continuous delivery pipelines


 KEY REQUIREMENTS



  • Experience in building large-scale data processing systems and large-scale data infrastructures

  • Experience within cloud platforms especially AWS

  • Good understanding of distributed computing principles

  • Able to work with the latest (NoSQL) database technologies such as Cassandra and Elasticsearch

  • Commercial or open source experience in software engineering (object-oriented design, coding and testing patterns) ·

  • Extensive knowledge in programming languages such as Java and Python 

  • Experience building data processing systems with Spark and Kafka using Java or Python






How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

About this job Location options: RemoteJob type: ContractExperience level: Mid-Level, SeniorRole: Full Stack DeveloperIndustry: Agile Software Development, Cloud Services, Product DevelopmentCompany size: 201–500 peopleCompany type: PrivateTechnologies php, angular, typescript, drupal, graphql Job description Experience: Senior Level Hello! Are you ready...
php angular typescript drupal graphql
Software Development
No Location
Hiring from: Europe, North America, South America, Southern Africa
About this job Location options: RemoteJob type: Full-timeExperience level: Mid-Level, Senior, LeadIndustry: Software DevelopmentCompany size: 51–200 peopleCompany type: PrivateTechnologies ruby-on-rails, ruby-on-rails-3, reactjs, javascript Job description We know that during this time there are concerns around the actuality of hiring needs,...
ruby-on-rails ruby-on-rails-3 reactjs javascript
Software Development
No Location
Hiring from: U.S. / Canada, Europe, North America, South America
Retail Zipline
Full time
Are you passionate about helping retail companies revolutionize the way they do business? Are you looking for a career that allows you to work with the world's best-known brands and Fortune 1,000 leaders? Our mission is to bring retail operations...
Software Development
United States
Hiring from: Anywhere
MicroTasks.io

Share you skills and get paid!

All from the comfort of your home.

LEARN MORE