26.6% Better Than Google NMT For English-to-Italian Consumer Goods

This English-to-Italian consumer goods translator uses a Slate Desktop personalized SMT that’s 26.6% more productive than Google NMT.

A Slate Rocks customer (a translator) created a translation engine with his or her translation memories (TMs) using a personal computer. This page describes the engine and compares the translator’s Slate Desktop experience to an experience using Google’s new-and-improved neural machine translation (NMT) technology. You can read the entire report with thirth (30) more customer experiences by downloading the full report Study of Machine Translated Segment Pairs.

Slate Desktop Engine Details

The customer started with translation memories in the language pair and industry of his or her work, totaling the estimated corpus size number of segments. Slate Desktop cleaned the TMs, prepared a training corpus and built the engine. Note that these processes typically runs overnight. During that processing, Slate Desktop also extracted a representative set consisting of randomly selected segments from the training corpus.

sourceen
targetit
subject domainconsumer-goods
estimated corpus size100,000
segments per representative set2,353
words per source segment17
words per target segment18

Benchmark Score Comparison

The segment pairs in the representative set are representative of the translator’s daily work. By focusing on one translator’s experience, these scores indicate a level of work reduction this customer will likely experience in his or her daily work using the respective MT system (Google or Slate Desktop) with 95% confidence.

 Google
NMT
Slate Desktop
SMT
words per MT segment1718
BLEU score33.0769.3
exact MT match (count)102700
exact MT match (percent)4.3%29.8%
words per exact MT match (count)512
filtered BLEU score (no exact MT matches)32.4761.78
segments requiring edit (count)2,2511,653
character edits per segment4131
total character edits92,29151,243

These scores indicate this customer using Slate Desktop will likely spend significantly less time editing MT suggestions than if he or she were using Google for this work. This is because Slate Desktop creates engines with the customers translation memories and optimizes them to predict how the customer translates. While on the other hand, Google optimizes its NMT service for millions of customers with countless demands.

Google’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that Google NMT successfully matched to the translator’s actual work, i.e. Google successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Google NMT results while translating these kinds of project.

enit (Google and translator)
Butter, olive oil, margarine, canola oil, sunflower oil, sesame oil.Burro, olio d’oliva, margarina, olio di canola, olio di semi di girasole, olio di sesamo.
The number of variants selected exceeds the maximum.Il numero di varianti selezionate supera il massimo.
Many scan results are above 40,000.Molti risultati di scansione sono superiori a 40.000.

Slate’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that this translator’s Slate Desktop engine successfully matched to the translator’s actual work, i.e. Slate Desktop successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Slate Desktop results while translating these kinds of project.

enit (Slate and translator)
If in the opinion of the Company, you are buying and returning Products merely to maintain your Executive status level, the Company may at its discretion change your distributor title to reflect the level of your activity as set forth in the SCP.Qualora la Società ritenga che l’Incaricato stia acquistando e restituendo prodotti esclusivamente per conservare la propria qualifica di Executive, essa potrà a sua discrezione modificare il titolo dell’Incaricato in modo da rispecchiare il suo livello di attività secondo quanto indicato nel Piano dei Compensi.
As the company continues to develop comprehensive health and skin care solutions for the anti-ageing industry, the TRADEMARK® Research Centre will become a beacon of innovation and integrity, setting the standard for others to follow.Mentre la Società continua a sviluppare soluzioni complete per la salute e la cura dermatologica destinate all’industria dei prodotti anti-età, il TRADEMARK® Research Centre diventerà un punto di riferimento in termini di innovazione e integrità, e definirà gli standard che altri seguiranno.
BRAND_NAME – used in conjunction with TRADEMARK®, this comb-like conductor glides easily through the hair and maintains close contact with the scalp to deliver the benefits of the treatment product to the hair and hair follicles.BRAND_NAME – Utilizzato in combinazione con TRADEMARK®, questo conduttore, simile a un pettine, scivola facilmente fra i capelli e mantiene il contatto con il cuoio capelluto per distribuire i benefici del prodotto ai capelli e ai follicoli
Advertisements