37.8% Better Than Google NMT For Spanish-to-English Medical

This Spanish-to-English medical translator uses a Slate Desktop personalized SMT that’s 37.8% more productive than Google NMT.

A Slate Rocks customer (a translator) created a translation engine with his or her translation memories (TMs) using a personal computer. This page describes the engine and compares the translator’s Slate Desktop experience to an experience using Google’s new-and-improved neural machine translation (NMT) technology. You can read the entire report with thirth (30) more customer experiences by downloading the full report Study of Machine Translated Segment Pairs.

Slate Desktop Engine Details

The customer started with translation memories in the language pair and industry of his or her work, totaling the estimated corpus size number of segments. Slate Desktop cleaned the TMs, prepared a training corpus and built the engine. Note that these processes typically runs overnight. During that processing, Slate Desktop also extracted a representative set consisting of randomly selected segments from the training corpus.

sourcees
targeten
subject domainmedical
estimated corpus size140,000
segments per representative set1,361
words per source segment19
words per target segment19

Benchmark Score Comparison

The segment pairs in the representative set are representative of the translator’s daily work. By focusing on one translator’s experience, these scores indicate a level of work reduction this customer will likely experience in his or her daily work using the respective MT system (Google or Slate Desktop) with 95% confidence.

 Google
NMT
Slate Desktop
SMT
words per MT segment1818
BLEU score44.3578.86
exact MT match (count)122590
exact MT match (percent)9.0%43.3%
words per exact MT match (count)513
filtered BLEU score (no exact MT matches)43.2370.13
segments requiring edit (count)1,239771
character edits per segment3828
total character edits47,08221,588

These scores indicate this customer using Slate Desktop will likely spend significantly less time editing MT suggestions than if he or she were using Google for this work. This is because Slate Desktop creates engines with the customers translation memories and optimizes them to predict how the customer translates. While on the other hand, Google optimizes its NMT service for millions of customers with countless demands.

Google’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that Google NMT successfully matched to the translator’s actual work, i.e. Google successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Google NMT results while translating these kinds of project.

esen (Google and translator)
bajo recuento de glóbulos blancos potencialmente asociado con fiebrelow white blood cell count potentially associated with fever
¿Puedo retirar o revocar (cancelar) mi permiso?Can I withdraw or revoke (cancel) my permission?
¿Cuál es el posible beneficio de participar en este estudio?What is the possible benefit of participating in this study?

Slate’s three (3) longest exact MT matches

The exact MT match (count) in the Benchmark Scores table (above) is the number of segments that this translator’s Slate Desktop engine successfully matched to the translator’s actual work, i.e. Slate Desktop successfully predicted the translator’s actions. The three segments in this table are the exact MT match segments with the longest length. This translator can expect to experience these kinds Slate Desktop results while translating these kinds of project.

esen (Slate and translator)
El Promotor tendrá el derecho único y exclusivo sobre las invenciones, descubrimientos o innovaciones, patentables o no, derivados de la observancia del Protocolo y de la realización del Estudio en virtud de este Contrato o resultantes de cualquier otro modo del uso, utilización indebida o modificación del Fármaco del Estudio en virtud del Contrato (las “Invenciones”).The Sponsor will have the sole and exclusive right over the inventions, discoveries or innovations, whether patentable or not, arising from the observance of the Protocol and of conducting the Study in accordance with this Agreement or resulting from any other mode of use, improper use or modification of the Study Drug in accordance with the Agreement (the “Inventions”).
Los datos personales del paciente están protegidos por la Ley Nacional 25326, se garantiza la confidencialidad y privacidad de los datos personales, se informa quiénes podrán tener acceso a sus datos de HC y por qué, debiendo el paciente permitir este acceso; de no permitirlo, no podrá participar en el estudio.The patient’s personal data are protected by National Law 25326. The confidentiality and privacy of personal data are guaranteed. The patient is informed of who may have access to MR data and why, and the patient must permit such access. If permission is not given, the patient cannot participate in the study.
En caso de contradicción entre este Contrato y el Protocolo adjunto ABC-123 (Anexo A), tendrán prioridad las estipulaciones del Protocolo en lo que respecta a la asistencia de los sujetos del Estudio y las estipulaciones del Contrato en lo que respecta a las demás cuestiones.In the event of a contradiction between this Agreement and attached Protocol ABC-123 (Appendix A), the clauses of the Protocol will take precedence as regards the health care of the Study subjects and the clauses of the Agreement as regards the remaining matters.