Bharat Kumar Javvadhi
Phoenix
Summary
Over 14 years of Information Technology experience, extensively in design and implementations of robust technology systems in Big Data (Hadoop), Linux Administration and Data Engineering. Over 10 years of experience in Hadoop Administration.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Hadoop Administrator
Visa Inc
03.2022 - Current
- Involved in Migration from HDP to Opensource Hadoop.
- Involved in LDAP to LDAPs migration for Ambari, Ranger and HDFS.
- Worked with Platform support team to troubleshoot and resolve issues including P1 issues on both batch and real time clusters.
- Environment owner for Realtime environments with 12 clusters.
- Worked with developers and architects in troubleshooting and analyzing jobs and tuned them for optimum performance.
- Add/Decommission nodes as they arrive to expand production cluster after thorough validation.
- Worked on tuning yarn configurations for efficient resource utilization in clusters.
- Planned and implemented production changes without causing any impacts and downtime. Documented and prepared change plans for each change.
- Perform cluster validations and run various pre-install and post install tests.
- Helping users in production deployments and onboarding process.
Senior Hadoop Administrator
American Express
01.2016 - 02.2022
- Involved in major/minor version upgrades in Cloudera & MapR clusters.
- Performed Minor Upgrades/Ecosystem upgrades on regular basis.
- Performed MapR Patches, Cloudera Hotfixes and OS/Firmware Patches on cluster to maintain interoperability.
- Performed ELK stack upgrade from 6.2.2 to 6.8.0 and 7.7.0.
- Performed Redis Upgrades from 5.2 to 5.4.10 and 6.0.6.
- Perform NIFI CFM upgrade from 2.0.x to 2.1.x
- Worked on troubleshooting and resolving issues including P1 issues on both batch and real time clusters.
- Worked on onboarding new flows and maintaining existing flows on NIFI.
- Created cluster health monitoring, node validation scripts along with other scripts to automate day to day tasks and patches/upgrades.
- Worked on monitoring, managing, configuring and administering batch, hbase, spark standalone, mapr-db and disaster recovery clusters.
- Worked on maintaining data mirroring process in remote DR clusters for all data being mirrored from all clusters so as to have backups available at any time.
Hadoop Administrator
Expedia
07.2015 - 12.2015
- Newly setup environments with POCs running and data residing in staging/pre-production environment using flume for ingestion.
- Worked with MapR vendor in building and setting up production/DR clusters from scratch for project.
- Aggregation operations done using hive, pig and oozie in stage clusters.
- Installed, configured, monitored and maintained services like Yarn, MaprReduce, Spark, Oozie, Hive, Pig, Flume, Sqoop, MaprFS, Zookeeper, and CLDB.
- Mapr-DB cluster which has in-Hadoop NoSQL DBMS allows application team developers to deliver scalable applications that also leverage continuous analytics on real time data and supports wide column data model and API to run existing Hbase applications.
- Installed MapR core and ecosystem components on single and multi-node clusters from scratch for production/non-production environments.
- Upgrade ecosystems components on regular basis like hive, oozie, spark, pig and sqoop to keep it updated.
- Perform cluster validations and run various pre-install and post install tests.
- Gained experience on architecture, planning and preparing nodes, data ingestion, disaster recovery, high availability, management and monitoring.
- Experienced in setting up project and volume setups for new Hadoop projects.
- Involved in snapshots and mirroring to maintain backup of cluster data and even remotely.
JR Software Engineer
Ericcson
05.2015 - 09.2015
- Working with data delivery teams to setup new Hadoop users.
- This job includes setting up Linux users, testing HDFS, Hive, Pig and MapReduce access for the new users.
- Cluster maintenance as well as creation and removal of nodes using Ambari.
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
- Screen Hadoop cluster job performances and capacity planning.
- Monitor Hadoop cluster connectivity and security.
- Configuring of Hive, PIG, Sqoop and Oozie.
- Manage and review Hadoop log files.
- File system management and monitoring.
- HDFS support and maintenance.
- Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
- Scheduling and Managing Oozie Jobs to automate sequence of rotational activity.
- Deciding on security and access control model for cluster and data protection.
- Testing plan of production cluster before and after Hadoop installation for HA's and performance.
- Planning on requirements for migrating users to production beforehand to avoid last minute access issues.
- Planning on data topology, rack topology and resources availability for users to share as required.
Graduate Teaching Assistantship
St. Mary's University
05.2014 - 12.2014
- Served as instructor on basic programming and robotics construction to undergraduate students.
- Designed a 3month course on programming with C language for high school level for a program called Upward Bound held in the University.
- Prepared inventory and designed lab sessions for the program.
- Designed various movement patterns for Vex Squarebots using C programming language for display at the UB showcase held at the end of summer.
- Organized a Vex Squarebot Soccer match using RF Transmitters in the UB showcase.
- Worked on evaluating student tests and grading.
- Provided feedback on tests.
Graduate Research
St. Mary's University
09.2013 - 04.2014
- Utilize and operate a FESCO Automatic Storage and Retrieval System (ASRS).
- Utilize Siemens STEP7 to write programs and download them into a Programmable Logic Controller (PLC).
- Responsible for writing instruction set to perform lab sessions on Vex Squarebot Assembly and programming to perform different patterns.
- Utilize Turtlebot with Create base and performed bring up, teleop operation and performed patters using ROS Framework and C++ programming language.
- Designed a complete bring up and practice manual for the Turtlebot and also designed a course with lab manuals to operate Turtlebot.
- Worked on Omron NJ Controller system with Vision System, prepared lab session manuals as a part of research.
- Worked on basic operation of a 3D Printer.
Senior Quality Assurance Analyst
HYIT/Serco Global Services
09.2009 - 07.2013
- (3 Year,10 Months) Tools : Quality Center (Google Map Maker Quality) Environment : Python, MYSQL Description: Quality Center tool is used for QC (Quality Check) the edits of maps where the edits are stored country wise (246 countries).
- It also contains two levels of QC and Meta-QC, Dispute resolution between QC and Meta-QC.
- Assigned daily and weekly workflow, maintained productivity and quality reports as a pod lead over a year.
- Conducted formal and informal product design reviews throughout the software development lifecycle to provide input on functional requirements, product designs, schedules and potential issues.
- Leveraged developer background to communicate effectively with software design team to become a valued “go-to” team member on challenging test cases.
- Worked on HTML, web testing, Real Time application (On Market hours).
- Designed and implemented automated testing tools and programs addressing areas including database impacts, software scenarios, regression testing, negative testing, error/bug retests and usability.
- Collaborated with PD, software engineering and Design to get business, functional and technical specifications, and perform tests to ensure bug free application.
- Documented software defects using bug tracking system and reported defects involving program functionality, output, online screen and content to software developers.
Education
Master of Science - Computers and Information Systems
St. Mary’s University of San Antonio
San Antonio, TX12.2014
Bachelor of Science - Electrical, Electronics and Communications Engineering
CMRCET
05.2009
Skills
- CDP 716, 718, CDH/CM 6x 7x
- HDP 265, 315, Ambari
- MapR 42, 52 and 61, MCS
- ELK - ElasticSearch, Logstash, Kibana
- RLEC - Redis Enterprise
- NIFI, CFM
- HDFS, Mapreduce/Yarn
- Spark: (Standalone/YARN)
- Pig, Hive, Sqoop, Oozie
- Zookeeper
- Hbase/MapRDB
- Machile Learning: RevR/Skytree/Grid Engine
- Filebeat, Grafana, Fluentd
- Apache Kafka, SMM
- Apache Tomcat, MYSQL
- Java, SQL, HiveQL and Shell/Bash
Certification
MapR Certified Administrator for Hadoop (MCHA)
Timeline
Hadoop Administrator
Visa Inc
03.2022 - Current
Senior Hadoop Administrator
American Express
01.2016 - 02.2022
Hadoop Administrator
Expedia
07.2015 - 12.2015
JR Software Engineer
Ericcson
05.2015 - 09.2015
Graduate Teaching Assistantship
St. Mary's University
05.2014 - 12.2014
Graduate Research
St. Mary's University
09.2013 - 04.2014
Senior Quality Assurance Analyst
HYIT/Serco Global Services
09.2009 - 07.2013
Master of Science - Computers and Information Systems
St. Mary’s University of San Antonio
Bachelor of Science - Electrical, Electronics and Communications Engineering
CMRCET
Similar Profiles
Pavan SunkaraPavan Sunkara
Lead Database Administrator at Visa IncLead Database Administrator at Visa Inc
Chetan NaikChetan Naik
Sr. Manager Merchant Partnership & Cobrands at Visa IncSr. Manager Merchant Partnership & Cobrands at Visa Inc
Andrew (Andy) HardyAndrew (Andy) Hardy
Senior Software Engineer at Visa IncSenior Software Engineer at Visa Inc