Skip to content
wanyingngPublic

Latest commit

 

History

3 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Alyssa

Meet Alyssa — your AI-powered coach for Amazon Behavioral Interviews.



Craft, refine, and practice compelling STAR stories aligned with Amazon's 16 Leadership Principles.

Problem

Behavioral interviews are often one of the most challenging aspects of Amazon's hiring process. While candidates may possess strong technical skills, many struggle to communicate their experiences effectively using the STAR (Situation, Task, Action, Result) framework or demonstrate Amazon's 16 Leadership Principles through compelling examples.

Although general-purpose AI chatbots can assist with interview preparation, they typically require users to repeatedly craft prompts, lead conversations, and understand prompt engineering to obtain consistent, high-quality results. This creates unnecessary frustration and makes interview preparation less accessible, especially for candidates with limited time.

Solution

Alyssa is an AI-powered Amazon Behavioral Interview coach built on AWS PartyRock that streamlines behavioral interview preparation through a guided, intuitive, and reusable workflow. Instead of relying on prompt engineering, users receive a structured coaching experience designed specifically for Amazon interviews.

Alyssa helps users:

  • Transform interview responses into compelling STAR stories.
  • Evaluate responses against Amazon's 16 Leadership Principles.
  • Receive actionable feedback to improve clarity, structure, and impact.
  • Practice using recent Amazon behavioral interview questions.
  • Build confidence through iterative interview preparation.

Target Audience

Alyssa is designed for:

  • Candidates preparing for Amazon behavioral interviews.
  • Participants in the AWS AI & ML Scholars program.
  • Professionals seeking promotions or career transitions.
  • Anyone looking to improve behavioral interviewing and storytelling skills.

Quickstart

  1. Open Alyssa on PartyRock: link
  2. Follow the in-app instructions to get started.

Prerequisites

  • An AWS PartyRock account (no credit card required)

Evaluation

Alyssa was evaluated by comparing its performance against a baseline chatbot powered by Gemini 3.5 Flash on common behavioral interview preparation tasks.

Guided workflow vs. general-purpose chatbot

Unlike a traditional chatbot, Alyssa provides a predefined workflow tailored specifically for Amazon behavioral interviews. Users are guided through each stage of interview preparation without needing to repeatedly craft prompts or determine what to ask next.

In addition, Alyssa automatically retrieves recent Amazon behavioral interview questions, creating a more streamlined and productive preparation experience.

Response quality and consistency

Alyssa consistently generates structured STAR stories by combining carefully engineered prompts, role-based instructions, and deterministic model settings.

The coaching experience is powered by Claude Sonnet 4.6 with a temperature of 0 to produce consistent outputs across sessions. Compared to the baseline chatbot, Alyssa produces responses that are more structured, consistent, and aligned with Amazon's Leadership Principles.

Prompt robustness

Prompt robustness was evaluated by attempting to persuade both Alyssa and the baseline chatbot to abandon their intended roles.

Alyssa consistently maintained its identity as an Amazon behavioral interview coach and rejected requests outside its intended scope. In contrast, the baseline chatbot was more likely to deviate from its original role, demonstrating greater susceptibility to prompt drift.

Reproducible user experience

To improve visual consistency, Alyssa uses fixed random seed values when generating images with Amazon Nova Canvas. Unlike general-purpose chatbots that may produce different images for identical prompts, Alyssa generates consistent visuals across sessions, creating a more polished and predictable user experience.

Decisions and Trade-offs

  • Purpose-built workflow instead of a general chatbot
    Alyssa prioritizes a guided and intuitive user experience over open-ended conversations, reducing the need for prompt engineering while limiting flexibility for unrelated tasks.

  • Deterministic model configuration
    Using a temperature of 0 improves consistency and reproducibility but may reduce creative variation in generated responses.

  • Role-based prompt engineering
    Carefully designed prompts improve coaching quality and reduce prompt drift, although they require more upfront prompt design and testing.

  • Integrated web search
    Automatically retrieving recent Amazon interview questions improves productivity but introduces dependence on external web content.

  • Fixed image generation seeds
    Reproducible visuals provide a more consistent experience at the expense of visual diversity.

Limitations

  • Alyssa is designed specifically for Amazon behavioral interviews and is not intended to replace comprehensive interview preparation for other companies.

  • The quality of coaching depends on the accuracy and completeness of the user's interview responses.

  • Leadership Principle evaluations are AI-generated and should complement, rather than replace, feedback from experienced interviewers.

  • Recent interview questions retrieved from the web may not reflect Amazon's actual interview process or future interview content.

  • The application focuses on behavioral interviews and does not assess technical interview performance.