Translation database fuzzy matches and word count demystified

InfoMail, December-2007
GlobalVision International, Inc.

Most content publishers, software or other, perform updates on their product, manuals, website, and marketing literature yearly or on a more regular basis. They update their source language files and engage their localization vendor or staff to update all the supported target languages.

Changes to the source files take the shape of additions (new text), removal of obsolete text (deletions), or edits (modifications to existing text).

The new text requires new translations for each target language. The deleted text is disregarded. The edited or modified text will require updating in all target languages.

When a top-down localization process is applied and a translation database (translation memory or TM) is in use, the search engine looks for segment changes (complete phrases or complete segments) to the source. The following is the result:

    Fig1: Example of fuzzy matching analysis

  1. No match or new text: Typically generates little match in the database and requires full translation.
  2. Repeat or unchanged text: Generates a 100% match from the database, not requiring any changes.
  3. Edited or modified text: Results in a “fuzzy” match. This is a match in the database that can be anywhere from 50-99% of the original. Anything under 50% is considered no match.
  4. Deleted text: Produces no impact on the translation update effort, since the text no longer exists.

Translation databases store language pair segments or sentences. A search engine is run on the newly released source text that analyzes the text one segment at a time, comparing it against what is already in the database.

  • If a 100% match is found, then it is considered an exact match.
  • If the search engine finds a similar but not an exact match, it allocates a fuzzy match percentage to it, anywhere from 50% to 99%.

For instance, a sentence with ten words having just one word difference from a sentence stored in the database will result in a 90% fuzzy match. If it has only five words in common with another sentence, then the fuzzy match is 50%.

By calculating the fuzzy match of each sentence, one can approximate the effort of translation needed to perform the full update in any target language.

At GlobalVision, we apply weights to strings to calculate the “equivalent” new word count to translate. For instance, the sentence with ten words having just one word changed since the last release is calculated as two new words to translate (20%). A sentence of ten words with four or more words changed is calculated as ten new words (100%). Other percentages are applied in between.

Internal changes to the sentence tags (bold, italic, links, internal font or color change, etc.) will also force a fuzzy match. A weight is applied to these changes as well, as they also require translator intervention.

The analysis and calculations are done by the translation database/search engine software. These are based on algorithms built in the software that objectively approximate the new number of words to translate. The results are not 100% exact, but during the past ten years in using these algorithms, we have satisfied all our clients.

Applying an appropriate weight to each fuzzy match is a process that we use to estimate not only the cost, but also the staffing and scheduling data. This is why we can accomplish 98% of our projects on schedule and on budget for our clients!

  • Share/Bookmark


This entry was posted in Articles. Bookmark the permalink. Both comments and trackbacks are currently closed.
  • Our Clients

    • Alcohol Countermeasure Systems logo
    • Active Endpoints logo
    • AirVersent logo
    • Biomerica logo
    • Canspan Communications logo
    • Constant Contact logo
    • Zeiss logo
    • Daktronics logo
    • DigiLabs logo
    • Diversified logo
    • DYMO logo
    • Ecovation logo
    • GibbsCAM
    • Intuitive Surgical logo
    • Jarden Consumer Solutions logo
    • Northwest Aluminum Specialties logo
    • NWL logo
    • Questia logo
    • Shore View logo
    • SolidWorks logo
    • Spark Creative Services logo
    • Spatial logo
    • Star Trac logo
    • The Cavanaugh logo
    • UW  Center for AIDS and STD : CFAR logo
    • The Mathworks logo
    • Telephonics logo
    • Adecco Group logo
    • Ciena logo
    • Coeur logo
    •  Optical Research Association logo
    • iCAD logo
    • Kaz logo
    • nVision Global logo
    • IMSI Design logo
    • Siemens logo
    • cfDesign logo
  • Freebies



     Free Quote Free Webinar Newsletter White Papers Audit

    Referrer

    Requirements

  • Testimonials

    • Constant Contact logo“We have had a lot of success working with GlobalVision… They are very receptive to our feedback during the project, and delivered a translation localization that was careful and deliberate.”
    • Intuitive Surgical logo“GlobalVision has been a great fit for our translation localization needs. We deliver a technically complex, high-value product, and we need translation quality that reflects that value.”
    • Alcohol Countermeasure Systems logo“GlobalVision understands the ramifications of incorrect technical data to a company that does a lot of engineering. Fortunately, they seem to get it right every time.”
    • Active Endpoints logo“I’d like to thank you and your team for a job well done. Speaking on behalf of the team you’ve made this a pleasant, efficient and painless experience.”
    • AirVersent logo“… GlobalVision has been our sole translation partner for all major releases and service packs since then. They are very cost-competitive, with strong project management skills…”
    • Biomerica logo“We are very impressed with GlobalVision’s professional approach to localization. Our product-update localization efforts and costs have gone down by as much as 30%.”
    • Canspan Communications logo“Working with GlobalVision is a breeze, I wish all our suppliers had the same work ethic! I never have to worry about prompt delivery and they provide us with excellent and thoroughly checked translation services.”
    • Zeiss logo“I am quite positively impressed. You met a very demanding schedule with a minimum of fuss required on my part. That is a big bonus for me. I haven’t had to nurse this project along…”
    • Daktronics logo“GlobalVision’s attentiveness to our needs and wants has made them an easy choice for our company’s translations. We can send them a document and it comes back ready to use, no extra work on our end.”
    • DigiLabs logo“…we solely use GlobalVision for all our translation needs, software, marketing materials and product specs. The delivery was always on time (many times ahead of time)”
    • Diversified logo“Highly recommended! … They have always been a pleasure to work with, and have provided our company with high-quality finished products.”
    • DYMO logo“While GlobalVision has provided excellent translation work for us, they also have very strong project management that allows them to meet their commitments on cost and delivery.”
    • Ecovation logo“We have been extremely pleased that we have found the right company to go to as we expand into other international markets.”
    • GibbsCAM“GlobalVision have the experience, expertise and takes pride in what they do and it shows in their professionalism in managing the project and delivering quality results on time… Highly, Highly recommended!”
    • Jarden Consumer Solutions logo“Translation is often a very difficult and challenging endeavor. GlobalVision always takes on the task with a high degree of initiative, thoroughness and professionalism.”
    • Northwest Aluminum Specialties logo“The work completed by GlobalVision was done on time, in budget, and conducted in a very professional manner. We would highly recommend GlobalVision as a supplier to any company needing translation services…”
    • NWL logo“… Now that we have used GlobalVision to translate work into 13 differed languages our Customers tell us that they could not have done a better translation.”
    • Questia logo“GlobalVision was a key part of launching our company’s international strategy. Their superior team helped us translate key web pages into eight foreign languages quickly and professionally.”
    • Shore View logo“We do appreciate how easy they have made this entire effort. Also, they were exceptionally pleasant to work with. Thank you.”
    • SolidWorks logo“After ten years of partnership with GlobalVision, SolidWorks can clearly attest to the success of the working relationship… The quality of the language translations has been high…”
    • Spark Creative Services logo“I always recommend GlobalVision to both clients and colleagues because I know their translations are accurate… they have not let me or my clients down!”
    • Spatial logo“GlobalVision is a top-notch company who not only delivers quality translations that meet or often beat deadlines, but also gives peace of mind that you are always receiving the best value in the industry.”
    • Star Trac logo
      “The service and professionalism of the staff was A+ … the staff maintained continued contact until the job was 100% complete.”
    • The Cavanaugh logo“GlobalVision always showed professionalism along with a detailed status of how the job was progressing. Their pricing was very competitive and projects were done on time.”
    • UW  Center for AIDS and STD : CFAR logo“I have worked with several translation agencies before discovering GlobalVision, and I can attest that GlobalVision’s quality of customer service is unparalleled.”
    • cfDesign logo“Product section looks really good, I’m impressed by the good translations!”

  •   Subscribe