40.4% Better Than Google NMT For English-to-Dutch IT Software

This Dutch-to-English IT software translator uses a Slate Desktop personalized SMT that’s 40.4% more productive than Google NMT.

A Slate Rocks customer (a translator) created a translation engine with his or her translation memories (TMs) using a personal computer. This page describes the engine and compares the translator’s Slate Desktop experience to an experience using Google’s new-and-improved neural machine translation (NMT) technology. You can read the entire report with thirth (30) more customer experiences by downloading the full report Study of Machine Translated Segment Pairs.

Slate Desktop Engine Details

The customer started with translation memories in the language pair and industry of his or her work, totaling the estimated corpus size number of segments. Slate Desktop cleaned the TMs, prepared a training corpus and built the engine. Note that these processes typically runs overnight. During that processing, Slate Desktop also extracted a representative set consisting of randomly selected segments from the training corpus.

`en
targetnl
subject domainit-software
estimated corpus size160,000
segments per representative set2,366
words per source segment14
words per target segment13

Benchmark Score Comparison

The segment pairs in the representative set are representative of the translator’s daily work. By focusing on one translator’s experience, these scores indicate a level of work reduction this customer will likely experience in his or her daily work using the respective MT system (Google or Slate Desktop) with 95% confidence.

 Google
NMT
Slate Desktop
SMT
words per MT segment1414
BLEU score31.2771.69
exact MT match (count)69997
exact MT match (percent)2.9%42.1%
words per exact MT match (count)710
filtered BLEU score (no exact MT matches)30.3860.18
segments requiring edit (count)2,2971,369
character edits per segment3026
total character edits68,91035,594

These scores indicate this customer using Slate Desktop will likely spend significantly less time editing MT suggestions than if he or she were using Google for this work. This is because Slate Desktop creates engines with the customers translation memories and optimizes them to predict how the customer translates. While on the other hand, Google optimizes its NMT service for millions of customers with countless demands.

Google’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that Google NMT successfully matched to the translator’s actual work, i.e. Google successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Google NMT results while translating these kinds of project.

ennl (Google and translator)
Please provide the recipient’s shipping address in the next panel.Geef het verzendadres van de ontvanger op in het volgende paneel.
Replace the data on the cloud with the data on this computer.Vervang de gegevens in de cloud door de gegevens op deze computer.
Increases the iron production of adjacent iron mines.Verhoogt de ijzerproductie van aangrenzende ijzermijnen.

Slate’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that this translator’s Slate Desktop engine successfully matched to the translator’s actual work, i.e. Slate Desktop successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Slate Desktop results while translating these kinds of project.

ennl (Slate and translator)
if you believe that any action has been taken against your account or device in error, please contact customer support at help.ea.com, support.example.com (for example products) or example.com/supportIndien u van mening bent dat er abusievelijk maatregelen tegen uw account of apparatuur zijn getroffen, neemt u contact op met de klantenservice via help.ea.com/nl, support.example.com (voor producten van example) of example.com/support
Visit your profile to view your recent activity and history, the amount of XX you have earned, and the amount of XX you need to reach the next level in ABC Life 15.Bezoek je profiel en bekijk recente activiteiten en geschiedenis, de hoeveelheid XX die je hebt verdiend en de hoeveelheid XX die je nodig hebt om het volgende niveau te bereiken in ABC LIFE.
If you choose to connect with friends on the application and you are “online,” your friends will receive notifications about your activity, application usage and stats.Als u via de toepassing contact maakt met vrienden en u “online” bent, ontvangen uw vrienden meldingen over uw activiteit, toepassingsgebruik en statistieken.