About the Role
Gramian Consultancy seeks experienced Subject Matter Experts (SMEs) from psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, and related advisory fields to support AI conversation evaluation research. You will review conversations between people and AI models, assess context sufficiency, identify missed clarification opportunities, and provide structured feedback to improve conversational quality.
Key Responsibilities
- Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, everyday planning, and wellbeing decisions.
- Evaluate whether the AI gathered sufficient context before providing advice, recommendations, or proposed solutions.
- Identify missing information and suggest relevant follow-up questions to improve AI response quality.
- Distinguish between load-bearing information that could change outcomes and non-essential details.
- Conduct qualitative reviews using structured evaluation guidelines and document findings consistently.
- Collaborate with research teams to maintain consistent evaluation standards and high-quality assessments.
Required Qualifications
At least 3–5 years of direct professional experience in one or more of the following domains:
- Licensed Social Work: MSW or equivalent with LCSW, LICSW, LMSW credential; experience in client assessment, case review, interviewing, or counseling.
- Counseling, Therapy, or Psychology: Master's degree with LMFT, LPC, LCPC credential, or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology; relevant client-facing experience.
- Qualitative Research, HCI, or Communication: MA, PhD, or advanced expertise in HCI, Communication, Anthropology, Sociology, or Qualitative Research; experience conducting interviews, user research, conversation analysis, or thematic analysis.
- Mediation, Coaching, Student Services, or Organizational Consulting: Relevant credential or demonstrated expertise; 5+ years of advisory or client-facing experience; demonstrated ability to gather context and provide informed recommendations.
Essential Skills: Strong analytical and interviewing abilities; capacity to distinguish essential, decision-changing information from less relevant details; systematic conversation analysis; understanding of personal, psychological, social, financial, and organizational factors.
Mise en forme par Postule ·
Signaler un problème