The Walt Disney Company IA/Data Management Platform DevOps Lead Engineer (Cloud) in Lake Buena Vista, Florida
Are you a DevOps guru who is passionate for creating solutions using cutting-edge technologies? Do you excel under pressure? Can you summarize highly complex problems so that others can help you solve them? Do you have rock solid integrity and are the team member people trust and count on? Does everyone turn to you for answers to tough questions? Do you instrument everything, collect data about data, and look for the correlation in everything? Do you like gathering evidence to base your decisions off of, but can use your gut, intuition and experience to make quick decisions when necessary? If you smile in the face of pressure, can work independently but are also great team player, we're looking for you!
Responsibilities : In this role, you will be managing very large-scale, highly-available Hadoop infrastructure supporting many-Petabytes of data and growing very rapidly. You will be a key part of the design, architecture, instrumentation and delivery of a massive data platform empowering Disney’s Innovation and Advantages. You will implement, troubleshoots, and optimizes distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Elastic Search, Kafka , etc. to solve large scale processing problems in a Cloud cluster environment. As a member of a cross-functional team, you'll have the opportunity to solve challenging operational problems across a broad range operations and services. You will be leading innovation by exploring, investigating, instrumenting, recommending, benchmarking and implementing data centric technology solutions for the platform.
Basic Qualifications :
Production experience with Dev Ops Tools like: Terraform, Packer, Mesos, Marathon, HAProxy, Apache, Linkerd Jenkins, Docker
Linux configuration, deployment, and troubleshooting
Experience in creating IAAS and PAAS platforms with Data Security, Availability, Resiliency at the heart of the platform with strong monitoring and operational mindset.
Knowledge and Experience of Elastic Load Balancers, Network configuration, Firewalls and troubleshooting to help collaborate with other Systems and Network Engineering Teams for Data Management Platforms
BigData technologies (Hadoop, HBase, ElasticSearch, Spark, NIFI, HDFS, Kerberos, Druid,AVRO, Parquet, ORC, Kafka)
Database knowledge like Oracle, SQL, MariaDB, DynamoDB
Experience with Software development and architectures like REST, microservices with Multi-cloud distributed architecture, support and planning utilizing enterprise Java, Python
Demonstrated interest and ability to quickly learn new technologies.
Natural influencer, and selfless team player, willing to help your team achieve great things
Excellent problem-solving skills; proven technical leadership and communication skills
Methodical and ability to Simplify and Refine
Willingness to participate in a 24x7 on-call rotation for escalation
Have a quality mindset, squash bugs with a passion, and work hard to prevent them in the first place through unit testing, test-driven development, version control, continuous integration and deployment.
Ability to lead change, be bold, and have the ability to innovate and challenge status quo
Experience using with Code Management/CICD tools like GITHub, Jenkins is useful
Prior experience with automation is helpful
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Experience with integration of data from multiple data sources
Ability to solve any ongoing issues with operating the cluster
Experience with scripting languages and automation of processes
Proven track record of development accomplishments in highly collaborative environment
Translate complex functional and technical requirements into detailed design
Be passionate about solving customer problems and develop solutions that result in a passionate customer/community following
Required Education :
BS or MS in Computer Science preferred, equivalent work experience will be considered.
Job ID: 554099BR
Location: Lake Buena Vista,Florida
Job Posting Company: Disney Parks & Resorts