Acosta Developer, Big Data Sr in United States, United States
The Sr Developer – Big Data - DevOps role reports to the Director, Data Sciences DevOps. The role is part of the DevOps team in charge of the daily operations of various integration technologies. The role is responsible for supporting workloads running on the Hadoop environment and associated technologies. This position will be responsible for monitoring the batch jobs, resolving incidents, optimizing workloads, tuning jobs, and making job enhancements.
The role will focus on production support and will also take part in the DevOps rotation for making enhancements. Also, the role will be involved in R&D of emerging technologies with the application administrators and technical architects.
Evaluate tools and technologies in the context of the future state architecture, and evolving business requirements
Responsible for review of project artifacts during the transition phase and ensure operational needs are met.
Research & development about new Hadoop & Analytical technologies
Review solution and technical designs
Propose best practices/standards.
Benchmark the performance in line with the non-functional requirements
Previous experience in developing and deploying operational procedures, tuning guides and best practices documentation.
Attention to detail to review project deliverables for completeness, quality, and compliance with established project standards.
3+ years developing and supporting applications leveraging the Hadoop stack
3+ of experience with data integration/ETL tools such as DataStage or alternatives
SDLC knowledge in both waterfall and agile methodologies
Hands-on experience with source code management system (SVN, Git) and continuous integration tools (Jenkins)
Experience on following tools: Hive, SQL, Spark, Kafka, Flume, Sqoop, HBase ,Pig, HDFS, R, NoSQL
Experience on handling data processing, delivering distributed and highly scalable application
Experience with HortonWorks Hadoop Distribution
Experience with large scale domain or enterprise solution analysis development, selection and implementation
Experience with high-volume, transaction processing software applications
Good understanding of workload management, schedulers, scalability and distributed platform architectures
Experience in software development and architecture experience using Java EE technologies (Application Server, Enterprise Service Bus, SOA, Messaging, Data Access Layers)
Experience in scripting languages & automation such as bash, PERL, and Python
Experience in data warehousing, analytics, and business intelligence/visualization/presentation
Experience using SQL against relational databases.
Working knowledge of search technologies like Lucene, Solr,
5+ years of hands-on experience on Linux , AIX, and z/OS
Excellent communication skills (both written and oral) combined with strong interpersonal skills
Strong analytical skills and thought processes combined with the ability to be flexible and work analytically in a problem solving environment
Attention to detail
Strong organizational & multi-tasking skills
Work State US
Job ID 2021-193321
Work City United States
PCN Sourcing Req
Position Type Regular Full-Time
Work Zip 00000
Starting average hours per week 37.5 +
Category Corporate Jobs