Linguist III Job at Varite, Redmond, WA

N2Vid0E4d1U5VFRhMjJBUUJNSzFMbHNsemc9PQ==
  • Varite
  • Redmond, WA

Job Description

Duration: 12 months
Summary:

We are looking for a skilled Linguistic Engineer to join our team to build, maintain, and analyze datasets powering LLM powered features. In this role, you will be instrumental in building and assessing the quality of data processed by our LLM production systems. Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross-functional team of engineers, research scientists, project managers, and data scientists to build datasets for, report on, and generally guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.

Job Responsibilities:
  • Aggregate cross-functional requests and translate requests into actionable, high quality, datasets via synthetic data collections and on live user traffic. Deliver analytics, statistics, and model performance results on datasets.
  • Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
  • Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
  • Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
  • Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
  • Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.
Skills:
  • Basic Python, basic SQL with strong desire to grow required for this position. Intermediate level preferred.
  • Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
  • Ability to analyze numerical rating results and draw conclusions based on data.
  • Basic stats / math for data analysis.
  • Written and oral communication skills necessary for communicating on project milestones and for reporting findings.
Education/Experience:
  • Bachelor's degree in Linguistics, Computational Linguistics, Speech Science, or related field OR graduate degree in linguistics OR industry similar experience required.
  • Master's degree or beyond preferred OR equivalent industry experience.
  • Additional learning via Coursera, Udemy, or other online resources is great too.

About US Tech Solutions: US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring.

#LI-AS140

Job Tags

Similar Jobs

Omni Inclusive

React js Developer Job at Omni Inclusive

 ...Experience Manager. The implementation will require knowledge of responsive styling and modern JavaScript frameworks such as Next.js, React. Extensive AEM implementation experience Expertise with Apache Sling Expertise with the Java Content Repository ... 

CRST

Class A Dedicated Truck Driver Job at CRST

 ...total transportation solutions and comprehensive logistics services to customers all over North America. We are looking for CDL A Truck Drivers to run a Dedicated Account Regionally ~ CDL A Truck Drivers ~ Dedicated Account ~ Weekly Hometime ~ SIGN ON BONUS... 

Allied Resources Technical Consultants

Substation Project Manager Job at Allied Resources Technical Consultants

About the Role: We are seeking a results-driven Project Manager to support a growing portfolio of capacity expansion, distribution, and cable program initiatives that are critical to maintaining system reliability and advancing grid modernization efforts. This role...

PeopleReady

Refuse Collector Job at PeopleReady

 ...Refuse Collector PeopleReady of Boardman, OH is now hiring Refuse Collectors in East Palestine, OH! Apply today and you could start as soon as tomorrow. As a PeopleReady associate you'll benefit from: Next-day pay for many of our open positions The choice... 

Gulfstream Aerospace Corporation

Aircraft Completions Supervisor Job at Gulfstream Aerospace Corporation

 ...Aircraft Completions Supervisor in GAC AppletonUnique Skills:This position is a full time, 1st shift position that works 4, 10-hour shifts Monday...  ...are completed effectively and efficiently. They will handle scheduling, training, and immediate problem solving. Plans...