Computer Science Subject Matter Expert - AI Evaluation (US-Remote) Join to apply for the Computer Science Subject Matter Expert - AI Evaluation (US-Remote) role at Braintrust Base pay range $75.00/hr - $90.00/hr Job Description: Seeking multiple Computer Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research. You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias‑aware, high‑quality datasets for LLM training. To Note: This is for an immediate project need. Project is approved for 3‑months initially, with possibility to extend based on project/client demands. To Note: Hourly rate range (75–90) is in USD per hour. Responsibilities: Partner with GenAI researchers/engineers to capture data needs and success criteria. Expand high-level requirements into clear, executable workflows for larger teams. Execute collection/evaluation workflows rapidly with minimal supervision. Innovate on workflows to maximize throughput and quality. Collaborate cross‑functionally to maintain quality at scale. Conduct in‑depth LLM‑assisted research; gather reliable, up‑to‑date info. Craft original, high‑quality content and hard problems for LLM eval/train. Perform rigorous fact‑checking (precision/recall) to prevent misinformation. Requirements: Education: Master’s with distinction or PhD in Computer Science; top‑tier institution preferred. Significant domain experience considered. Detail orientation; precise data presentation; thorough proofreading. Communication: articulate complex info; strong collaboration. Understanding of AI/LLMs, their capabilities/limits. Prompt engineering and familiarity with AI writing tools. Ethical AI awareness and data literacy (collection, cleaning, transformation). Thrives in fast‑paced, minimally supervised environments. Seniority level Entry level Employment type Full‑time Job function Engineering, Information Technology, and Science Industries Technology Information and Internet Computer and Network Security #J-18808-Ljbffr Braintrust
...Responsible for supporting safe, proper shuttle operations through scheduling, employee communication... .../Operations Manager. Facilitate monthly driver meetings, company training requirements,... ..., thorough knowledge of all SFO Airport terminals and the major streets,...
A prominent research institute in California seeks a Research Associate II to assist in groundbreaking cancer research, focusing on RNA/DNA studies. The ideal candidate holds a Bachelors or Masters degree and has laboratory experience. Responsibilities include supporting...
...Correctional Registered Nurse - $2,101 per week at Genie Healthcare summary: This position is for a Correctional Registered Nurse providing healthcare services within a correctional facility in Watonga, Oklahoma. It is a 13-week travel assignment with 36 hours per week...
...Job Description Job Description CDL A Driver - Williston, VT $32/hr Local Routes Home Daily - $2,500 sign on Bonus Full-Time | MondayFriday... ...for local, full-time work operating a 53' curtain side truck. If you're looking for a dependable schedule, excellent...
...Regular Full-Time \n \n\n \n Location : Postal Code 72211\n \n\n \n Location : Address 12208 West Markham Street \n \n\n \n Remote No \n \n\n \n Posted Min Pay Rate USD $65,000.00/Yr. \n \n\n \n Posted Max Pay Rate USD $127,255.00/Yr. \n \n\n \n...