Authors :
Arya K A; Shelja Jose M
Volume/Issue :
Volume 8 - 2023, Issue 1 - January
Google Scholar :
https://bit.ly/3IIfn9N
Scribd :
https://bit.ly/3In5KjU
DOI :
https://doi.org/10.5281/zenodo.7642130
Abstract :
This paper deals with advancements that have
occurred in the field of Natural language processing. Most
of the text prediction-related tasks are conducted in
different dialects but not in Malayalam. Numerous
frameworks with various techniques were produced for
various dialects. Only a few of the models fit into
Malayalam. In this paper, the BERT algorithm is applied
to the Malayalam language. BERT uses bi-directional
pre-training on multiple tasks such as Next Sentence
Prediction and Masked Language Model. This paper
mainly deals with the Next sentence prediction.
Keywords :
BERT, Malayalam Next Sentence Prediction.
This paper deals with advancements that have
occurred in the field of Natural language processing. Most
of the text prediction-related tasks are conducted in
different dialects but not in Malayalam. Numerous
frameworks with various techniques were produced for
various dialects. Only a few of the models fit into
Malayalam. In this paper, the BERT algorithm is applied
to the Malayalam language. BERT uses bi-directional
pre-training on multiple tasks such as Next Sentence
Prediction and Masked Language Model. This paper
mainly deals with the Next sentence prediction.
Keywords :
BERT, Malayalam Next Sentence Prediction.