NiFi - Setup Development Environment

We are glad to come up with Tech Series on Mondays where we will be talking about a particular topic between 4 to 8 weeks. Some of them will be free and some of them will be paid. In case you want to get notified in case of events, please sign up to our Meetup group - https://www.meetup.com/itversityin/

NiFi is one of the key tools in the area of Data Engineering and Big Data. It is primarily used for Data Ingestion and Orchestration. As part of 6 to 8 workshops between August and September, you will be learning key capabilities. Live sessions will be free and pre-recorded videos will be available exclusively for members of our YouTube channel after a week.

Here is the link to become member of ITVersity Channel - https://youtube.com/itversityin/join

As part of the NiFi Series, in this session, I will walk through how to set up a development environment to learn the core capabilities of NiFi.

Here is the material for this session - https://github.com/dgadiraju/nifi-workshop/blob/master/01%20Setup%20Environment.md

* Provision Server from AWS - https://www.youtube.com/watch?v=Z4pDhBaWB64
* Setup Pre-Requisites
* Setup and Configure Hadoop
* Start and Validate Hadoop Components
* Setup and Validate Spark - https://www.youtube.com/watch?v=jcdAO90yY2U
* Setup and Start NiFi

Playlist - https://www.youtube.com/playlist?list=PLf0swTFhTI8rt0Bk0RAFC5-S6CUNrVQva

Stay tuned for upcoming sessions on the core capabilities of NiFi.

* Building generic data ingestion flows
* Converting File Formats
* Writing conditional flows based upon attributes
* Triggering Shell Commands or Spark Jobs
* Transforming inflight data
* Logging Attributes and Messages
* Scheduling, Monitoring, and Alerting
and many more

Key Takeaways for those who sign up for the workshop.:
* Free end to end workshop to provide data ingestion solutions using NiFi
* Code is available as part of our public GitHub repository for free - https://github.com/dgadiraju/nifi-workshop
* Live support for members in case if our YouTube members are struggling to take care of setting up the environment.
* Limited support using Slack