Module 1 · Start safely
Bias and fairness in recruitment
In short
Protected traits, from age to irrelevant health conditions, are not criteria unless a lawful job requirement. Check rubrics and test items for bias and hidden stand-ins. A model repeats the bias you give it.
After this lesson you can
- Recognise protected traits and their stand-ins in hiring criteria and screening rubrics
- Check the wording of recruitment test items and scoring rubrics for bias
- Apply the Manpower Law's equal opportunity and treatment principle when using AI for recruitment
Terms in this lesson
Understand
Indonesia's Law No. 13 of 2003 on Manpower contains two principles that bear directly on hiring. Article 5 says every worker has an equal opportunity, without discrimination, to obtain work. Article 6 says every worker has the right to equal treatment, without discrimination, from the employer. The law was amended by the Job Creation law now in force as Law No. 6 of 2023, and Constitutional Court decision No. 168/PUU-XXI/2023 changed several other employment provisions. So always check the latest official text before quoting it. This lesson is a general picture, not legal advice.
For everyday work we translate that principle into one rule: age, sex, religion, ethnicity or race, marital status, pregnancy, disability, place of residence or origin, photo or appearance, and health conditions not relevant to the job do not become screening criteria or rubric points, unless there is a lawful and genuine job requirement. A lawful requirement is usually tied directly to the task or to another rule, such as the minimum working age. Such requirements are checked with HR and legal, and the reason is written down. Otherwise, criteria judge skills and work results.
AI adds two kinds of risk. First, a model repeats the bias you give it. If a criterion says at most 30 years old or attractive appearance, the model will apply it diligently to every CV, and an unfairness that was one sentence now falls on hundreds of applicants. Second, model bias can appear unasked. A model learns from human text, including its prejudices. It may describe a leader with male pronouns, rate certain names or schools higher, or treat a career gap as a weakness when the gap may have been maternity leave or caring for family.
What is often missed are stand-ins: data that does not name a protected trait but carries it. Graduation year implies age. A photo implies appearance, sex and sometimes religion. An address can imply ethnicity or economic class. A career gap can imply pregnancy. A rubric that gives points for graduating no more than five years ago is in fact screening on age. So a bias check does not stop at a list of banned words; for each criterion it asks whether this really measures the job.
Test items can be biased too. A reasoning item that uses examples from a particular sport, regional terms or situations familiar only to one group tests familiarity, not reasoning. An item with more than one right answer punishes the candidate who reads more carefully. An interview rubric that gives points for confidence or a convincing way of speaking often favours a particular speaking style. When AI helps write items or rubrics, ask it to check for these, then check yourself: solve each item from scratch, and read each rubric point while picturing candidates from different backgrounds.
One small habit helps: keep a bias-check note for each opening. It lists the criteria removed or changed, the reason, and who checked. The note is useful when the same opening is posted again, because old requirements most often come back through copy-paste from the previous post.
Before
The prompt
Make a screening rubric for a customer service role. Requirements: female, at most 28, unmarried, attractive appearance, graduated no more than three years ago.
What came back
Customer Service Staff Screening Rubric: 1. Female (mandatory). 2. Age at most 28 (mandatory). 3. Unmarried (10 points). 4. Attractive appearance based on photo (1-5 points). 5. Graduated 2023 or later (10 points). ...
After
The prompt
Goal: I need a CV screening rubric for customer service staff that judges skills, not personal traits. Reader: recruiters who will use this rubric to read CVs. Material: the role's main tasks are answering complaints by phone and messages, logging tickets and escalating technical problems; rotating shifts. Limits: do not use age, sex, religion, ethnicity or race, marital status, pregnancy, disability, place of residence or origin, photo or appearance, or health conditions not relevant to the job, and no stand-ins such as graduation year. If you think such a requirement is lawful, write it as a question for HR, not as a criterion. Shape: 4-6 criteria, each with an example of CV evidence and a 1-3 scale. Check: for each criterion, say whether data standing in for a personal trait could slip in.
What came back
1. Customer service experience (evidence: work in a shop, service or sales). 2. Written communication (evidence: writing reports or replying to messages). 3. Tidy record-keeping (evidence: using a ticket system or spreadsheets). 4. Willingness to work shifts (asked at interview, not guessed from the CV). Stand-in check: do not give criterion 1 extra points for experience at well-known companies, because that can screen on school or city background.
What changed
- The first model applied every discriminatory requirement without asking, because that is what it was asked.
- The second request supplies the job's tasks as material, so the criteria can be derived from the work.
- Willingness to work shifts is asked directly, not guessed from marital status.
Common mistake
- Mistake
- Removing the age column from the rubric but still giving extra points to fresh graduates and rejecting CVs with long career gaps.
- Why it hurts
- Graduation year and career gaps carry age, and often pregnancy or caring duties. The protected trait comes back through the back door, and the model will apply it consistently.
- Do this instead
- For each criterion, ask what it really measures. If what you need is skill with current systems, assess that skill directly, not the graduation year.
Try
Sorting card
Which criteria judge the work, and which judge a personal trait or its stand-in?
Lives in the same district as the office
Has handled customer complaints in writing
Graduated at most five years ago
Willing to work rotating shifts
A formal photo with a neat appearance
Can build a weekly stock recap in a spreadsheet
6 cards left
AI writes a reasoning item for a recruitment test: If all defenders play at the back, and Rudi plays as a sweeper, then ... What is the main problem?
Prompt to check a rubric or test items for bias
Works with any AI assistant.
Your prompt
Goal: I want to check ‹dokumen› for bias before it is used in hiring. Reader: me and the HR colleagues who will decide the changes. Material: the document text below, inside DATA markers. ‹teks› Limits: do not rewrite the document; only point out problems. Do not conclude whether anything breaks the law. Shape: a table: section, problem (protected trait, stand-in, non-neutral term, more than one right answer), suggested fix. Check: also name the parts you think are fine and why, so I can judge your reasoning.
Take home
Bias check before an opening goes live
- No age, sex, religion, ethnicity or race, marital status, pregnancy, disability, place of residence or origin, photo or appearance, or health conditions not relevant to the job in the criteria
- No stand-ins: graduation year, photos, address, career gaps
- Any requirement that looks like a personal trait has been checked by HR and legal, with the reason written
- Every test item has been solved from scratch and has exactly one right answer
- Items and rubrics use neutral situations and terms
- A bias-check note is kept for this opening
What went wrong for us
Protected traits stay out of the criteria
- Context
- When drafting job criteria and screening rubrics with AI, a user's first request sometimes includes conditions on age, sex, religion, ethnicity or race, marital status, pregnancy, disability, place of residence or origin, photo or appearance, or health conditions not relevant to the job.
- What tends to go wrong
- This is a rule we keep. Those traits do not become screening criteria or rubric points, unless there is a lawful and genuine job requirement that HR and legal have checked and whose reason is written down.
- What it costs if ignored
- Indonesia's Manpower Law guarantees equal opportunity and treatment without discrimination. A model given such criteria will apply them diligently to every candidate, so the unfairness multiplies by the number of applicants.
- Root cause
- Old conditions are often copied from earlier job posts without being questioned, and a model tends to follow a request rather than challenge it.
- How we do it
- Every criterion is written as a skill or work result that can be checked. Draft rubrics are reread specifically to find protected traits or their stand-ins, such as graduation year standing in for age.
- The rule we keep
- The standing instructions for the screening tool say protected traits are not scored and that the model must flag any criterion that looks like one, not apply it.
The lessonFair criteria judge the work, not who the person is.
What it means for your workReread every requirement in your job post and ask: is this a skill the job needs, or a trait of the person?
