Mortgage and technical experience in Big Data space. Results oriented, technical leader in Big Data strategy, building hybrid-cloud data platform for mortgage industry in AWS using S3, EC2, EMR, Athena
Responsibilities
- Designing the solution to load mainframe data to cloud (AWS) to power advanced analytics and other business initiatives.
- Implemented Kerberos Authentication for the DataHub.
- Design and Development Ingestion application to ingest Extracts from Mainframe to Hadoop/Hive
- Design and Development of Reporting Object Stores for all Microservices.
- Design of DaaS to leverages the data ecosystem and real-time data analytics to create custom dataset.
- Secured Nifi and Nifi Registry.
- Design of Reporting solutions.
- Designed and implemented a micro service using SpringBoot for adding Clients to the DataHub
- Technical Lead in designing Big data initiatives at Black Knights DataHub Initiative.
- Hadoop Administration and Solution development.
- Designed and Implemented various Sqoop ETL process and optimized the overall ETL process.
- Big Data/Hadoop Solution Architecture, Design & Development with HortonWorks HDP 2.6
- Hands-on experience in designing and implementing big data solutions using HDFS, Map Reduce,Storm, Kafka, Hive, Pig, Flume, Yarn, HBase, Oozie, Zookeeper, Kerberos,SpringBoot
- Streaming Data from Different data sources to HDFS with a proven Java based framework.
- Design and Development of various sqoop and HBase initiatives.
- Designed and Implemented the Multitenancy within the Hadoop Cluster.
- Implementing Security features such as Knox, Ranger, Ranger KMS etc.
- Authentication and Authorization design for Hive and HBase components.
- Worked on securing the data implementing TDE within Cluster and Protegrity to secure the files.
- Security Features surrounding the data stored within HDFS.
- Securing Data in Hadoop and Laying out the best practices.
- Loading mainframe VSAM files to Hadoop file system via Syncsort.
Knowledge-based economies use ICT, innovation and research, higher education and specialized skills to create, disseminate and apply knowledge for growth.
Importance of creating a knowledge-based economy
• A shift to innovation-based growth would help countries avoid the middle-income trap and also address rising income inequalities.
• The advantage of availability of cheap labour from which countries like India and China and others in the region derive the strength that adds so much value to their economies is likely to disappear in the near future.
Initiatives are
MobileSeva: • To integrate the delivery of government services (across various Departments)
Vikaspedia: • To provide information on health, education, agriculture, energy, social welfare and e-governance in more than 10 languages. MyGov.in: • To ensure citizens’ engagement in decision making by the government for the ultimate goal of “good governance” for building India.
Aadhaar: • Enabled Biometric Attendance System: In order to bring in efficiency in the Government, an Aadhaar enabled Biometric attendance system was implemented by MeitY.
e-Payment Framework: • All payments and receipts to be in electronic mode.
Common Services Centre • Provides ICT enabled front-end service delivery outlets, across rural India covering six lakh villages.
Jan Dhan Yojna and Digital Sakshartha Abhiyan (DISHA) are conducted through CSCs.
State Wide Area Network • It has been identified as an element of the core infrastructure for supporting the e-governance initiatives.
GI Cloud • In order to utilise and harness the benefits of Cloud Computing, Meity has embarked upon an initiative – “GI Cloud” which has been coined as “MeghRaj”.
Information Technology Investment Region (ITIR) • Meant to attract major investment by providing transparent and an investment friendly policy; help in exports and employment. National Policy on Universal Electronic Accessibility • It recognizes the need to eliminate discrimination on the basis of disabilities and to facilitate equal access to Electronics & ICT. Promotion of Manufacturing of Electronics and IT-ITES • It is estimated that demand for electronics products and systems in India would grow to about US$ 400 billion by 2020. Other minor initiatives • Promotion of R&D and Innovation Technological Incubation and Development of Entrepreneurs (TIDE) ; Multiplier Grant Scheme (MSG); National Supercomputing Mission (NSM). National Digital Literacy Mission was approved in March, 2014. The Scheme aims to train 10 lakh persons. Digital Empowerment of citizens by providing Universal Digital Literacy is a part of ‘Digital India’ initiative. Cyber Security • National Cyber Security Policy (2013) is aimed at building a secure and resilient cyberspace for citizens, businesses and Government, by way of actions to protect information and information infrastructure in cyberspace, build capabilities to prevent and respond to cyber threats, reduce vulnerabilities and minimize damage from cyber incidents. • National Cyber Co-ordination Centre is being set-up with an aim to generate cyber security situational awareness to anticipate and prepare for cyber attacks. Organizations related to it Botnet Cleaning and Malware Analysis Centre • CERT-In is implementing this for detection of compromised systems in India and to notify,enable cleaning and securing systems of end users to prevent further malware infections. National Informatics Centre (NIC) • National Informatics Centre (NIC) is a premier IT organization of the country under the Department of Electronics and Information Technology. • It was established in 1976, • NIC, through its ICT Network, ‘NICNET’, has institutional linkages with all the governments and governments departments at all levels. • NIC services include Certifying Authority, Video-Conferencing, NIC e-MAIL (NICeMail) and SMS services across the country. National Knowledge Network (NKN) has been set up to connect institutions/ organizations carrying out research. Open Technology Centre (OTC) has been set up as a nodal agency for Open Technology related activities in e-Governance applications managed by NIC/NeGP and promotes the use and adoption of Open Source tools/software. • It has established and maintains state data centersand other infrastructure related to NeGP. Controller of Certifying Authorities (CCA) • The IT Act promotes the use of Digital Signatures for e-Governance and e-Commerce through legal recognition to electronic records and treats digital signatures at par with hand written signatures. • The CCA licenses Certifying Authorities (CA) to issue Digital Signature Certificates under the IT Act and also exercises supervision over the activities of these Certifying Authorities. • The CCA certifies Public Keys of the CAs, lays down standards to be maintained by the CAs and performs other functions. • These are being used in applications such as Real Time Cross settlement System & EFT of the RBI, e-mail, electronic funds transfer, e-Procurement, share trading; issue of import/export licenses by DGFT and filing of company returns with the Ministry of Company Affairs. Cyber Appellate Tribunal • The first and the only Cyber Court in the country has been established by the Central Government in accordance with the provisions contained under section 48(1) of the Information Technology Act, 2000. Provision has been made in the amended IT Act, 2009 for the Tribunal to comprise a Chairperson and many other members, as the Central Government may notify/appoint. C-DAC • Centre for Development of Advanced Computing (C-DAC) is the premier R&D organization of the Department of Electronics and Information Technology (DeitY for carrying out R&D in IT, Electronics and associated areas. • C-DAC is pursuing activities in the following thematic areas: • High Performance Computing (HPC), Grid Computing and Cloud computing • Computing Multilingual Computing (HPC), Grid Computing Professional Electronics including VLSI and Embedded Systems • Software Technologies including FOSS • Cyber Security and Cyber Forensics • Health Informatics • Education and Training Some applications developed by C-DAC are • One of the significant achievements of the past year was upgradation of the compute power of PARAM Yuva system from 54 TF/s to 529 TF/s. • In the area of Cloud Computing, C-DAC launched its cloud platform, Meghdoot 1.0 during the Technology Conclave at Hyderabad in October, 2012. • In the area of Professional Electronics, C-DAC completed the development of WiTrac (Wireless Traffic Controller) and made its first deployment this year. • Several electronic devices and associated solutions were also built for smart buildings. These include LED Luminaire, Human Occupancy Prediction System and Indoor Air Quality Monitoring System. • In the area of Software Technology, release of a new version of BOSS Linux operating system and its wider deployment were carried out during the year. • Several e-Governance applications and frameworks including e-Praman with Andhaar, • In Health Informatics area, C-DAC carried out larger deployment of C-DAC tele medicine solutions. C-DAC also initiated the development of health care services on mobile devices, m-Health and m-Swasthya are two such solutions. Wider deployment of e-Vision and e-Nose systems was carried out during the year. • C-DAC is also involved in carrying out various activities in the northeast region through various Government supported initiatives. National e-Governance Division • It was established as amalgamation of experts from the private sector and the Government for discharging the key tasks including programme management and technical support of various components of the Digital India Programme. National Internet Exchange of India • NIXI is a not for profit organization set up under Companies Act, 1956 for peering of ISPs among themselves and routing the domestic traffic. Unique Identification Authority of India(2009) • “To empower residents of India with a unique identity and a digital platform to authenticate anytime, anywhere”. National Institute of Electronics and Information Technology • Scientific Society of the MeitY, which is actively engaged in capacity building and skill development in the areas of Information Technology (IT). Software Technology Parks of India • Autonomous society under MeitY, meant for promotion of software exports by acting as ‘single-window’ in providing services to the software exporters. Media Lab Asia. To bring the benefits of ICT to the common man, such as ICT for healthcare, education, livelihood and empowerment of disabled. Department of Telecommunication • Indian Telecom Sector has grown exponentially and become 2nd largest network in the world, next to China. Number of telephones increased from 99.61 Cr to 103.6 Cr at the Dec,2015. • Department is committed to provide secure, reliable, affordable and high quality converged telecommunication services anytime, anywhere; with special focus on underserved areas in North-Eastern Region and backward areas, especially the Left Wing Extremism areas. • While wireless voice and data services continued to grow, the landline provided remarkable support to high speed data services. Share of wireless telephones increased to 97.54% of total. Public vs. Private • Share of private sector in the total number of connections increased to 89.88 % at the end of Dec, 2015, over public sector share of 10.12% during the same period. • Tele-density, which denotes the number of telephones per 100 population, which was 79.36 % in April 2015, increased to 81.85% at end of Dec, 2015. Himachal Pradesh (124.54 %) had the highest tele-density followed by Tamil Nadu (117.27 %). Bihar (52.55%) is lowest. Unified Licence • In pursuance ofNTP-2012 to create one nation-one license, Department of Telecommunication has issued guidelines on Unified Licence under which, the allocation of spectrum is delinked from licence and has to be obtained separately as per bidding process. Foreign Direct Investment (FDI) Policy • Government raised FDI limit for the telecom services from 74 %to 100 %. RBI has expanded the existing definition for infrastructure sector for the purpose of availing External Commercial Borrowing (ECB). Universal Service Obligation Fund • To give impetus to the rural telephony, the Government in June, 2002, established Universal Service Obligation Fund (USOF). Bharatnet • To connect all 2.5 lakh gram panchayats in country, the Government approved a project called ‘National Optical Fiber Network, now known as BharatNet. Rural Wire-Line Broadband Scheme • USOF signed an agreement with BSNL for providing wire-line broadband connectivity up-to village level in rural and remote areas. Regulatory Framework • Telecom Regulatory Authority of India has always endeavoured to encourage greater competition in the telecom sector together with better quality and affordable prices in order to meet the objectives of National Telecom Policy (NTP)-2012. Research and Development • C-DOT is committed to providing a wide range of cost-effective, indigenously developed and state-of-the-art total telecom solutions. • DoT has the following PSUs a) BSNL b)MTNL c) ITI Limited; d) Telecommunications Consultants India Limited (TCIL); e) Bharat Broadband Network Limited (BBNL); f)Hemisphere Properties India Limited (HPIL). Vision of Digital India • It aims to transform the country into a digitally empowered society and knowledge economy, implemented in phases till 2018, by DeitY. It would also bring in public accountability through mandated delivery of Government’s services electronically; a Unique ID and e-Pramaan . The source of funding is through budgetary Provisions. Scope of Digital India a) To prepare India for a knowledge future; b) On being transformative that is to realize IT (Indian Talent)+ IT (Information Technology) =IT (India Tomorrow); c) Making technology central to enabling change; d) On being an Umbrella Programme covering many departments. Initiatives under the Digital India Programme (i) Legal Information and Management Based System is an easy to access, web-based tool for comprehensive, regulatory and proactive monitoring of court cases. (ii) NDSAP (National Data Sharing and Accessibility Programme) is to facilitate the access to Government of India owned shareable data and information. (iii) e-Office: The main objective of e-office is to improve efficiency, consistency and effectiveness of government responses; Way ahead • India has the potential to become a leading knowledge-based economy with its youth population and growing information technology. • Policy — if at all — must simply be more in the realm of enlightened inducement that encourages and engenders good practices. It must nurture and encourage initiative and out-of-the-box thinking and should be, to an extent, ready to accommodate risk taking and have room for failure. • Institutions have to move out of traditional modes of thinking and must recognize that knowledge can exist in all realms, not just in formal systems around academia. • The need to develop and nurture educational institutions in a manner that ensures their linkages to the needs and challenges of the nation — including its economic needs. This requires inducing young minds to grapple with the challenges of the nation and society. • Steps such as supportive laws, improved infrastructure, removal of barriers to trade and investment, up-skilling of labour force, higher spending in R&D and innovative financing for small businesses must be taken urgently. • Regulatory, education, and infrastructure barriers must be overcome. • What is required is a strong, coordinated government policies coupled with investment in ICT including universal, affordable and high-speed broadband connectivity, better education notably tertiary and skills-focused training, and a culture of research and innovation with strong intellectual property rights. Flexible capital and labor markets are also crucial.
However, in the last few years, this IT-BPM model in India has taken a hit for a number of reasons. First, there is a growing backlash in the West against off-shoring, as it is perceived as a way of denying jobs to the locals.
Second, the rise of Artificial Intelligence (AI) and its various offshoots — Machine Learning, Deep Neural Networks, etc — are rapidly changing the landscape in which the skilled jobs operate. As a result, while the IT-BPM industry continues to be the dominant player in the Indian economy, its foundation is beginning to get shaky.
While AI and Information Communication Technology (ICT) rapidly transform economies and usher in the Fourth Industrial Revolution, it becomes imperative for India to carve its own niche around these technologies. This requires India to transform into a Knowledge Economy (KE). There are three pillars around KE: institutions, research and development (R&D), and human capital
NEED TO GRIND MORE ON THE FOLLOWING GROUNDS-
1. In comparison with Google till today Indian software companies earn 1/4th and moreover include more workforce than Google. This is because of tech-backwardness, lagging in out of box thinking and improper family planning.
2. India is an ‘over-populous’ country. Automation threatens labour intensive industries. Avoiding demographic trap is hence difficult. Government and policy makers have to coordinate with industry and academia to encourage out-of-box thinking and research, while accommodating risk-taking.
Can India be considered as KBE?
About 50% of India's GDP comes from service sector. While this may be considered as paving way for India's path to become KBE, we are far from being one which can be seen from
1.Lack of Innovation: A cursory view at some of the sectors like manufacturing, pharma is enough to aver that India needs to traverse a long and tedious path to be KBE. Even IT sector, the much touted domain of India's dominance is based on outsourcing rather than innovation.
2.Lack of Research & its quality: Quality and type of research in higher institutions,funds apportioned to R&D, lackadaisical approach of private sector in research all point to the fact that lot needs to be done to be KBE. The number of Nobel prizes won by India despite the mammoth population is a testament to this.
INDIA CAN BE CONSIDERED AS A KNOWLEDGE BASED ECONOMY-
1. India is the 2nd largest country in the global distribution of tertiary degree holders share at nearly 78 million after China in STEM (science, technology, engineering, mathematics) subjects.
2. Bengaluru is the fastest changing and most dynamic city in the world according to the JLL City Momentum Index 2017. It has done in terms of the ‘speed of progress in property’, ‘economics’ and ‘digital success’.
3. TeamIndus, the only Indian team in Google LunarXPRIZE competition, has built a privately funded spacecraft capable of soft landing on the Moon. Along with this, PSLV-C37 successfully launches 104 satellites from a single rocket in its low cost space exploration programme deserves ‘celebration’.
4. India recently has overtaken ‘China’ and reached the top position in terms of remittance receiver.
5. Indian Technical education is poorly funded and lags behind. Consequently, India is at 60th position in World Innovation Index by WIPO, which is ranking based on patents and research papers filed.
6. ‘Medical diplomacy’ is also at the scale of rise, especially in terms of Gulf countries.
Conclusion :
The shift to knowledge-based growth is critical since India’s comparative advantages in labor and capital-intensive manufacturing are fading. New technologies like robotics, and increasing stress on resources like energy and water, are emerging as threats to Asia’s competitive edge. A shift to innovation-based growth would help India avoid the middle-income trap and also address rising income inequalities.
No comments:
Post a Comment