Big Data Processing Expert, Madrid


Empresa contratante: HAYS

Salario: Sin Especificar

Big Data Processing Expert en Madrid.
Be a key driver on BASFs path to digitalisation by supporting existing products and initiatives as well as innovate additional digital solutions that supports BASFs global businessesYou will be part of the unit Knowledge Innovation, responsible for a knowledge system containing a huge number of scientific documents. You will be working in an international and dynamic environment. Your responsibilities will include: – Build (big) data pipelines for complex and distributed data processing – Closely collaborate with the product team to understand requirements, work out and implement new features for fast and insightful interaction with data – Implement security principles and align with our external security consultants – Work in an international team and agile environment Must have qualification – A degree in computer science, software engineering, or mathematics/natural sciences or similar experience – 5+ years of building (big) data pipelines for complex and distributed data processing – Experience with distributed data processing frameworks like Spark – Experience working with high volumes of unstructured data (text, documents) – 3+ years of experience with Java/Scala or Python – Experience working in a DevOps environment using development tools and CI/CD pipelines, also with containers and container orchestration – Experience using cloud environments – Fluent communication in English is required Nice to have – Experience using graph databases, full-text search engines, document-oriented databases and messaging systems – ideally Neo4j, ElasticSearch, MongoDB and RabbitMQ. – Experience with tools like Airflow or Talend

Spark, Java, Scala, Python,


Por favor, para apuntarte a este trabajo visita

Compartir en

Otras ofertas de trabajo