Code&Data Insights
[Machine Learning] Natural Language Processing(NLP) | Bag-Of-Words Model 본문
[Machine Learning] Natural Language Processing(NLP) | Bag-Of-Words Model
paka_corn 2023. 6. 21. 04:56[ Natural Language Processing(NLP) ]
Natural Language Processing(NLP) : Natural Language Processing involves the development of algorithms and models that allow computers to comprehend, generate, and interpret sentences, as well as extract meaning from text.
=> NLP Process
(1) text data is collected and preprocessed. During this stage, the text is segmented into sentences or words through tokenization, and unnecessary information is removed or normalized.
(2) machine learning and statistical models are employed to understand and process the text data. These models aid in understanding sentence structure, semantics, and context, utilizing various algorithms and techniques.
=> Types of NLP
- Text Classification , Sentiment Analysis, etc.
=> Classic NLP vs Deep Learning NLP
[ Bag-Of-Words Model ]
Bag-Of-Words Model
- Use Classification, BOW is a simple and commonly used technique in Natural Language Processing (NLP) for representing text data as numerical vectors.
- It is based on the assumption that the order of words in a document does not carry important information and focuses solely on the presence or absence of words in the document.
