Computer Science Subject Matter Expert - AI Evaluation (US-Remote) Join to apply for the Computer Science Subject Matter Expert - AI Evaluation (US-Remote) role at Braintrust Base pay range $75.00/hr - $90.00/hr Job Description: Seeking multiple Computer Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research. You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias‑aware, high‑quality datasets for LLM training. To Note: This is for an immediate project need. Project is approved for 3‑months initially, with possibility to extend based on project/client demands. To Note: Hourly rate range (75–90) is in USD per hour. Responsibilities: Partner with GenAI researchers/engineers to capture data needs and success criteria. Expand high-level requirements into clear, executable workflows for larger teams. Execute collection/evaluation workflows rapidly with minimal supervision. Innovate on workflows to maximize throughput and quality. Collaborate cross‑functionally to maintain quality at scale. Conduct in‑depth LLM‑assisted research; gather reliable, up‑to‑date info. Craft original, high‑quality content and hard problems for LLM eval/train. Perform rigorous fact‑checking (precision/recall) to prevent misinformation. Requirements: Education: Master’s with distinction or PhD in Computer Science; top‑tier institution preferred. Significant domain experience considered. Detail orientation; precise data presentation; thorough proofreading. Communication: articulate complex info; strong collaboration. Understanding of AI/LLMs, their capabilities/limits. Prompt engineering and familiarity with AI writing tools. Ethical AI awareness and data literacy (collection, cleaning, transformation). Thrives in fast‑paced, minimally supervised environments. Seniority level Entry level Employment type Full‑time Job function Engineering, Information Technology, and Science Industries Technology Information and Internet Computer and Network Security #J-18808-Ljbffr Braintrust
...mechanical systems desirable; familiarity with test system development desirable; lab view experience desirable Company Description CGI, Inc - a leader in the design and manufacturing of precision motion control products - utilizes its comprehensive technical knowledge...
...insurance, life insurance, and more Job/Practice Description: Full Time Employed position clinical psychiatry 80% + Medical Director duties 20%; Mon-Fri work schedule with 1:4 weekend call; case load 16-20/day FOR MORE...
...Analyst / Associate to support enterprise-level warehouse transformation initiatives... ...and ROI tracking Job Requirement ( Entry ~ Junior Level )- Bachelors degree in... ...needed for projects and site support Business Hours Mon-Fri 08:00 AM to 5:00 PM...
The Practice Manager at Hometown Veterinary Partners is a member of hospital team and reports directly to the Partner DVM or the President. The Practice Manager will support our core beliefs of Culture, Collaboration and Community. The Practice Manager is empowered to provide...
Job Description Job Description Kims Import | Independent Auto Repair & Dealership Kims Import is a locally owned, independent auto shop thats been serving Issaquah since 2009, specializing in asian vehicles. We are a small team that takes pride in offering quality...