Senior Data Engineer Job Vacancy in Autodesk Bengaluru, Karnataka – Updated today

Are you looking for a New Job or Looking for better opportunities?
We got a New Job Opening for

Full Details :
Company Name : Autodesk
Location : Bengaluru, Karnataka
Position :

Job Description : Job Requisition ID #
22WD57867
Position Overview
We’re seeking engaged and dynamic engineers to join a team within Customer Platform & Data (CPD) organization. You will be working on Advanced Compliance Products (ACP), a collection of systems and teams focused on detecting and exposing non-compliant users of Autodesk software. This is a key strategic initiative for the company The focus of this role will be to manage the technical development of the tools supporting the analysis of the audit data essential for these reports. This role will own the logic development of non-compliance categories and the aggregation of customer data working closely with focus groups, technical teams, and analysts to ensure clear business requirements and global consistency
As a Senior Data Engineer, you will be responsible for developing best practices and making architectural decisions to rapidly improve critical data processing & analytics pipelines. You will tackle hard problems to improve the platform’s reliability, resiliency, and scalability We are looking for someone who thrives on autonomy and has experience driving long-term projects to completion. You are detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk. Our tech stack includes Airflow, Hive, EMR, PySpark, Presto, Jenkins, Snowflake, Datadog and various AWS services
Responsibilities
You will be tasked with modernizing and expanding a critical set of existing systems
You will need a product-focused mindset. It is essential for you to understand business requirements and architect systems that will scale and extend to accommodate those needs
Break down complex problems, document technical solutions and sequence work to make fast, iterative improvements
Build and scale data infrastructure that powers batch and real-time data processing of billions of records
Develop CI/CD ETL pipelines using Jenkins for deployment and automation testing
Take ownership of ETL pipelines, own data quality for your areas, and ensure SLAs are met
Interface with data engineers, data scientists, product managers and all data stakeholders to understand their needs and promote best practices
Minimum Qualifications
3-5+ years of relevant industry experience in big data systems, data processing and SQL data warehouses
At least 3+ years of experience on working with large Hadoop projects and building scalable applications using PySpark by leveraging Spark DataFrame and Spark SQL api
At least 2+ years of experience in optimizing Spark applications, spark memory management, and e2e spark process optimization
Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
Fundamental knowledge of distributed data processing systems, storage mechanisms, and compression techniques
Experience building code-driven infrastructure on public cloud platforms, preferably AWS
Understanding of SQL, dimensional modeling, and analytical data warehouses, like Snowflake, Redshift
Knowledge of Data Modeling techniques and high volume ETL/ELT design
Familiar with workflow management tools, like Airflow and Oozie
Experience with CI and code management tools like Git, Jenkins
Familiar with BI tools, like Power BI, Looker, Qlikview
Problem solver with excellent written and interpersonal skills; ability to make sound, complex decisions in a fast-paced, technical environment
Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience
Preferred Qualifications
Any Certification in Spark
Good Understanding of AWS EMR ecosystem and deploying spark applications on EMR
At Autodesk, we’re building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.
Autodesk has always valued flexibility in how we work. We continue to provide employees flexibility to support their work preferences wherever possible and nearly all roles are hybrid or remote, unless otherwise indicated.
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers .

This post is listed Under  Technology
Disclaimer : Hugeshout works to publish latest job info only and is no where responsible for any errors. Users must Research on their own before joining any company