Java Developer Engineer
Experian
Heredia, Heredia, Costa Rica
hace 3 días

Responsibilities

  • Design a generic framework for high throughput and streaming data ingestion, curation and linkage for the Experian Data Fabric a Data as a Service platform intended to be configured / extended for deployments across the globe
  • Develop high throughput and streaming data pipelines using Experian Lambda Architecture; Internal bulk sources to include server logs, file uploads, database logs, relational sources and CDC;
  • streaming sources to include web sockets, HTTP client callbacks, and kafka events

  • Develop rules-driven, data transformation layer that can be rapidly configured / deployed at business units and geographies globally
  • Build components for standardization, data curation, identity resolution and end-to-end traceability at dataset and record levels
  • Develop data provisioning components to deliver data for operational analytics as well as research purposes
  • Develop ultra-low latency micro services to serve data from the State Container within 10 milliseconds
  • Requirements :

  • 5+ years hands-on experience as Software Developer / Engineer
  • 4+ years Java / Scala development background
  • 1+ year experience working with native MapReduce and / or spark
  • Desired - 2+ years data engineering / ETL development experience working with data at scale
  • Desired - 2+ experience with Heroku or Docker
  • 1+ year experience across one or more of the following Hadoop, MapReduce, HDFS, Cassandra, HBase, Hive, Flume, Sqoop, Spark, Kafka, etc.
  • Bachelor's degree in Computer Science, Engineering or quantitative discipline
  • Reportar esta oferta
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Inscribirse
    Mi Correo Electrónico
    Al hacer clic en la opción "Continuar", doy mi consentimiento para que neuvoo procese mis datos de conformidad con lo establecido en su Política de privacidad . Puedo darme de baja o retirar mi autorización en cualquier momento.
    Continuar
    Formulario de postulación