Demystifying NLP (Natural Language Processing): A Beginner’s Overview — Part I: Data/Text Preprocessing

Artificial Intelligence (AI) has emerged as the new tech buzzword in 2023 with the launch of ChatGPT in late 2022 (generative AI to be more exact). In simple terms, AI is technology that enables computers to perform a variety of advanced functions, including the ability to see, understand and translate spoken and written language, analyze data, make recommendations, and more.

Coming from a non-technical background, I have always wanted to dive deeper and better comprehend the fundamentals of technical concepts. Even if I am not able to code at such complexity, an overall understanding of the workflow and an understanding of the concept/terminologies will allow me to engage better with technical people (+ engineers). I hope this article sheds some light to those non-technical people who may have/may be going through a similar thought process.

Over the course of next few articles, I will first cover NLP (Natural Language Processing) and related concepts.

Natural Language Processing (NLP)

Simply put, natural language processing is an overarching term for a branch of artificial intelligence that focuses on helping computers understand the way that humans write and speak. Such…