fb Data engineer @ ValueLabs

Job Description

Data engineer

Expires on : 20220130
Job Code : VL/10-08-2021/0282
Experience : 4-7 Years
Location : Hyderabad

• We are looking for an Data engineer who has experience in Scala, spark,Kafka • Cloud technologies and Programming skills experience

Roles & responsibilities: Coordinate with a team of Data Engineers and developers to develop and deploy solutions for clients. • Explore, innovate, benchmark • Conduct POCs, recommend, and implement big data technologies for platforms. • Perform ad-hoc analyses of data stored in the business databases and write SQL scripts, stored procedures, functions, and views. • Troubleshoot data issues within the business and across the business and present solutions. • Proactively analyze and evaluate the business’s databases to identify and recommend improvements and optimization. • Keep up with industry trends and best practices, advising senior management on new and improved data engineering strategies that will drive departmental performance leading to improvement in overall improvement in data governance across the business, promoting informed decision-making, and ultimately improving overall business performance.
• Primary Skills - Objective orientend programing like - Scala, python,Java or golang along with Kafka streaming and Good SQL knowledge good to have - Spark • As at least 3 years of working experience as a data engineer role within a fast-paced a complex business setting. • Implementing schema changes, and maintain data architecture standards • Development and implementation of scripts for database maintenance, monitoring, performance tuning, and so forth. • Designing and developing scalable ETL packages from the business source systems including routines to populate databases. • Data migrations across databases and servers. Defining and implementing data stores based on system requirements and consumer requirements. • Performing thorough unit-testing and validation in order to support the accuracy of data transformations and data verification used in machine learning models. Ensure proper data governance and quality. • Prepare activity and progress reports regarding the business database status and health. Analyze complex data elements and systems, data flow, dependencies, and relationships and contribute to conceptual physical and logical data models. • Collaborate with client teams, develop scripts for database maintenance, monitor and performance-tune. • Works collaboratively with the entire Data and Analytics team, providing support to the entire department for its data centric needs. • The candidate must demonstrate experience working with large and complex data sets as well as experience analyzing volumes of data. • System management expertise with monitoring, disaster recovery, backup, automated testing, automated schema migration, and continuous deployment. • Excellent Communication Skills • Exceptional analytical skills, showing fluency in the use of different tools and paradigms related to data engineering. • Strong Interpersonal Skills and People Skills

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.