How deep you are involved with Natural Language Processing (NLP)
Thread poster: Joel Pina Diaz
Joel Pina Diaz
Joel Pina Diaz  Identity Verified
Mexico
Local time: 09:13
English to Spanish
+ ...
May 17, 2020

Among several, the neural network-based technique for natural language processing (NLP) pre-training, called Bidirectional Encoder Representations from Transformers, or "BERT", is changing your models to search either from ranking and/or featured snippets cracking your queries mostly in US English but near future will add several languages (a market open for translators).

"One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because N
... See more
Among several, the neural network-based technique for natural language processing (NLP) pre-training, called Bidirectional Encoder Representations from Transformers, or "BERT", is changing your models to search either from ranking and/or featured snippets cracking your queries mostly in US English but near future will add several languages (a market open for translators).

"One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because NLP is a diversified field with many distinct tasks, most task-specific datasets contain only a few thousand or a few hundred thousand human-labeled training examples. However, modern deep learning-based NLP models see benefits from much larger amounts of data, improving when trained on millions, or billions, of annotated training examples. To help close this gap in data, researchers have developed a variety of techniques for training general purpose language representation models using the enormous amount of unannotated text on the web (known as pre-training). The pre-trained model can then be fine-tuned on small-data NLP tasks like question answering and sentiment analysis, resulting in substantial accuracy improvements compared to training on these datasets from scratch..."

Language understanding remains an ongoing challenge and we are in the trend to ride up...

Full information in the following link (Google A.I. Blog): https://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html
Collapse


 


To report site rules violations or get help, contact a site moderator:

Moderator(s) of this forum
Maria Castro[Call to this topic]

You can also contact site staff by submitting a support request »

How deep you are involved with Natural Language Processing (NLP)






Trados Studio 2022 Freelance
The leading translation software used by over 270,000 translators.

Designed with your feedback in mind, Trados Studio 2022 delivers an unrivalled, powerful desktop and cloud solution, empowering you to work in the most efficient and cost-effective way.

More info »
TM-Town
Manage your TMs and Terms ... and boost your translation business

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

More info »