Hiring Pyspark Hive SQL Developer – Gurugram/Remote Job Vacancy in Incubit Global Business Services Pvt. Ltd. Gurgaon, Haryana – Updated today
Are you looking for a New Job or Looking for better opportunities?
We got a New Job Opening for
Full Details :
Company Name : Incubit Global Business Services Pvt. Ltd.
Location : Gurgaon, Haryana
Position :
Job Description : Joining: Immediate or 30 daysLocation: Gurgaon (Remote)About Incubit, and the difference we make Here at Incubit, we believe in doing work that makes an impact on the World. We are an enterprise solutions company, providing integrated technology consulting, services, products and outsourcing to our clients across the globe. With an incredibly talented and diverse team who love working with us, we combine our unparalleled problem-solving abilities with extensive experience across core business functions to create unmatched value at all business levels.We collaborate with clients to help them become high-performance businesses by elevating experiences across their business spectrum. Our passion resonates in the work that we do, so if you are all in. So are we.Our website : www.incubit.comAbout the role and The TeamIncubit is looking for a smart, result-oriented, passion-driven person to join in the position of Pyspark Hive SQL Developer as part of the team for our leading Fortune 500 client. This person should have excellent communication skills with highest work ethics. This position will manage direct projects with Client.ResponsibilitiesExperience in creating a framework using Pyspark for streaming real-time data requests.Build end-to-end data solution from requirement gathering, design, modeling, development and implementationExperience in build and deployment of Big data applications using SparkSQL, SparkStreaming in Python.Ability to design and build Python based code generation framework.Develop Spark Streaming applications for real time Processing.Apply different Transformations and actions in pyspark, Spark-SQL like joins and collect.Import log files organizations from mainframes using Golden Gate Software and injected these logfiles into hive tables by creating hive external tables for each type of log files.Write complex Hive and SQL queries for data analysis to meet business requirements.Creating Hive external tables to store the GGS output. Working on them for data analysis to meet the business requirements.Used ESP schedule jobs to automate the pipeline workflow and orchestrate the map reduces jobs that extract the data on a timely manner.Involve in Hive performance optimizations like partitioning, bucketing and perform several types of joins on Hive tables and implementing Hive serdes like JSON and Avro.Design and implement Map Reduce-based large-scale parallel relation-learning system.Work with Parquet, Avro Data Serialization system to work with all data formats.Implement several types of scripts like shell scripts, python, and HQL scripts to meet the business requirements.Experienced in managing and reviewing Hadoop log file.Experienced in working with different scripting technologies like Python, Unix shell scripts.Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive.Designed and developed a corporate intranet that is used in daily workflow to increase.Drives and leads solution design services, including requirements analysis, functional and technical design leadership, and documentation / review with business and IT constituentsUse agile development environments using continuous integration and deployments.Skills Required· Minimum 2 years of Hive hands on exposure· Experience of pyspark is mandatory· Worked with SQL, MySQL/ PostgreSQL is plus· Should be detailed oriented· Deliver on tight timelines· Accountable for his responsibilityExperience – 3-5 years of relevant experiencePreferred Qualifications – B. Tech / M. Tech or other equivalent degreeJob Types: Full-time, Regular / PermanentSalary: ₹1,500,000.00 – ₹2,200,000.00 per yearBenefits:Provident FundWork from homeSchedule:Day shiftSpeak with the employer+91-XXXXXXXXXX
This post is listed Under Technology
Disclaimer : Hugeshout works to publish latest job info only and is no where responsible for any errors. Users must Research on their own before joining any company