BigData Engineer

Quantta Analytics (http://www.quantta.com/) is an IT and analytics startup in India with heavy emphasis on location analytics and predictive analytics. We have been around for last five years and have worked with more than 70 clients - local, national, and multinational level wherein our work cover scale as large as pan-India and as micro as 1sqkm grid.

We are on a mission to build one of the largest data directory coupled with advanced analytics in India. To meet this goal, we are using latest cutting-edge technology to build our tech stack.

We are looking for a BigData Engineer who is passionate about BigData and related technologies to support our analytical needs. Your role is to help build a scalable analytics platform to perform real-time data analytics to predict customer behaviour. This will involve a deep understanding of consumer behaviour, psychology, and the latest Open Source tools that can be put to work on structured and unstructured data to understand and predict behaviour. Ideally you should have worked in domains like customer segmentation, customer propensity, customer communication.

 Expected Outcome:

• To build the sustainable big infrastructure that is capable of large scale real time and batch data analysis.
• Build the common implantation library that can be reused across variety of data analysis/
• Implement large sale data scraping, storage and analysis combining information from multiple sources. Ability to build a global view of customer/business from the disparate, unstructured information derived from multiple sources.

 Skills Required:

• Deep understanding of technology and major trends including Spark, Hadoop, hive and other columnar data bases (e.g. redshift)
• Expertise in relational databases like postgres, mysql.
• Expert understanding of SQL and DataFrames
• Experience with Apache NiFi, Oozie, airflow and other similar workflow management framework
• Expertise in either of Java, Python or Scala.
• Working knowledge of AWS and cloud infrastructure
• Strong inter-personal skills and the ability to manage a high-energy, growth-oriented work environment

 Experience:

• Proven track record in building large scale Big Data applications using Spark, Hadoop.
• Worked with global business problems and data sets in both structured and unstructured data
• 3 - 5 years of experience with BigData development work

 Challenges:

• Build and Implement the one of the largest data platforms
• Strategize and ideate the product road map including technology stacks, cutting edge big data solutions, customer facing solutions
• Scale the product to fulfil the needs and aspirations of a million people
• Bring speed of development in a multi-cultural environment

We offer an excellent platform to learn and grow on the job.