kateforsberg commited on
Commit
f54681b
·
1 Parent(s): e7445ae

updated answer generation rules

Browse files
outputs/professor_guide.csv CHANGED
@@ -1,10 +1,8 @@
1
- MC,,1,Identify the strategy B2C services companies use to refine their offerings before scaling.,1,B2C services companies deliver the value manually after conducting presales to refine their offerings before scaling.,"B2C services companies scale first, then conduct presales for feedback. ","B2C services companies refine offerings through automated systems, not presales. ","B2C services companies deliver value digitally, avoiding manual processes. ","B2C services companies start with a global launch, skipping presales. ",98-99, Knowledge
2
- MC,,1,Identify the profession of Herbie Hancock mentioned in the textbook.,1,"Herbie Hancock is a jazz musician, composer, and actor.","Herbie Hancock is a blues musician, poet, and photographer.","Herbie Hancock is a pop musician, sculptor, and producer. ","Herbie Hancock is a classical musician, writer, and director. ","Herbie Hancock is a rock musician, painter, and dancer. ",88-90, Knowledge
3
- MC,,1,Explain the purpose of using a Split Test in evaluating customer behavior.,3,"A Split Test compares two versions, Control C and Variant B, to determine which performs better in improving customer behavior. ","A Split Test compares two versions, Control A and Variant D, to determine which performs better in improving customer behavior. ","A Split Test compares two versions, Control A and Variant B, to determine which performs better in improving customer behavior.","A Split Test compares two versions, Control B and Variant B, to determine which performs better in improving customer behavior. ","A Split Test compares two versions, Control A and Variant C, to determine which performs better in improving customer behavior. ",270-273, Comprehension
4
- MC,,1,Identify the key steps involved in preparing a simple landing page for a presale according to the textbook.,3,"Create a simple landing page, insert price options, show a pop-up on click, and implement email marketing. ","Create a simple landing page, insert price options, show a pop-up on click, and add customer testimonials. ","Create a simple landing page, insert price options, show a pop-up on price option click, and integrate web analytics.","Create a simple landing page, insert price options, show a pop-up on click, and enable social media sharing. ","Create a simple landing page, insert price options, show a pop-up on click, and verify payment processing. ",274-277, Knowledge
5
- MC,,1,Identify the purpose of conducting partner and supplier interviews before building a solution.,2,Analyze their potential before implementing the solution independently.,To better understand their capabilities before building it yourself.,Evaluate their resources before constructing the solution yourself. ,Assess their strengths before developing the solution on your own. ,Understand their limitations before creating a solution independently. ,306-309, Knowledge
6
- MC,,1,Identify the main advantage of using clickable prototypes over paper prototypes in product design.,4,Clickable prototypes yield fewer insights into customer interactions than paper prototypes. ,Clickable prototypes give minimal insights into customer interactions compared to paper prototypes. ,Clickable prototypes offer less evidence of customer interactions than paper prototypes. ,Clickable prototypes provide stronger evidence and insights into customer interactions than paper prototypes.,Clickable prototypes provide weaker insights into customer interactions than paper prototypes. ,236-239, Knowledge
7
- MC,,1,Summarize the key requirements for creating an effective data sheet.,1,"A data sheet requires specifications, a value proposition, and consideration of technical performance and benefits for target customers or partners.","A data sheet demands evidence strength, basic web software, and feasibility testing.","A data sheet involves run time, qualitative insights, and marketing strategies. ","A data sheet needs setup time, partner feedback, and technical insights. ","A data sheet requires cost analysis, customer feedback, and design skills. ",190-193, Comprehension
8
- MC,,1,Identify the ideal run time for a Feature Stub experiment to avoid customer frustration.,5,15–20 days,11–14 days ,7–10 days ,4–6 days ,1–3 days,156-159, Knowledge
9
- MC,,1,How could social media campaigns be used to increase brand loyalty and drive sales?,4,Social media campaigns can frustrate customers with irrelevant content and interactions. ,Social media campaigns can alienate customers by ignoring their feedback consistently. ,Social media campaigns can confuse customers with inconsistent messages over time. ,Social media campaigns can increase brand loyalty and drive sales by engaging customers through targeted messages and interactions over time.,Social media campaigns can decrease brand loyalty by overwhelming customers. ,168-171, Application
10
- MC,,1,Explain how customer support analysis helps businesses with existing customers.,3,Expert stakeholder interviews guide organizations to uncover product deficiencies.,Validation surveys assist firms in discovering customer desires via web traffic. ,"Customer support analysis helps businesses uncover unmet jobs, pains, and gains by analyzing existing customer data.",Sales force feedback aids companies in identifying customer behavior patterns. ,Customer interviews help businesses find unmet needs through stakeholder insights. ,142-145, Comprehension
 
1
+ MC,,1,Explain the purpose of using a validation survey in product development.,1,A validation survey is used to gather insights on whether customers would be disappointed if a product went away or if they would refer it to others.,A validation survey is used to analyze market competition trends. ,A validation survey is used to evaluate employee performance metrics. ,A validation survey is used to assess product pricing strategies. ,A validation survey is used to measure customer satisfaction levels. ,278-283, Comprehension
2
+ MC,,1,Explain the main requirement for conducting a Wizard of Oz experiment effectively.,3,"The main requirement is capabilities, as it involves diverse skills for execution. ","The main requirement is setup time, as it involves planning and acquiring customers. ","The main requirement is time, as it involves manually creating and delivering the product to the customer.","The main requirement is evidence, as it involves gathering customer feedback. ","The main requirement is cost, as it involves scaling expenses significantly. ",284-287, Comprehension
3
+ MC,,1,Identify the ideal percentage of customers who should be disappointed if a product goes away according to the textbook.,2,Approximately 30% of customers should be disappointed. ,More than 40% of customers should be disappointed.,Fewer than 10% of customers should be disappointed. ,Exactly 50% of customers should be disappointed. ,Less than 20% of customers should be disappointed. ,278-283, Knowledge
4
+ MC,,1,Summarize the main purpose of conducting a Wizard of Oz experiment in product development.,3,The Wizard of Oz experiment is used to develop automated customer service systems. ,The Wizard of Oz experiment is used to analyze customer satisfaction surveys. ,"The Wizard of Oz experiment is used to manually create, capture, and deliver value to learn firsthand about the necessary steps before scaling.",The Wizard of Oz experiment is used to evaluate digital marketing strategies. ,The Wizard of Oz experiment is used to automate processes before testing. ,284-287, Comprehension
5
+ MC,,1,Explain the purpose of using a Split Test in evaluating customer behavior and conversion rates.,5,A Split Test analyzes the effect of advertising on brand recognition. ,A Split Test measures the impact of price changes on sales volume. ,A Split Test evaluates customer satisfaction between two identical products. ,A Split Test compares two unrelated products to gauge market interest. ,"A Split Test compares two versions, Control A and Variant B, to determine which performs better in improving customer behavior and conversion rates.",270-273, Comprehension
6
+ MC,,1,What is the purpose of using a life-sized prototype in product development?,1,To test higher fidelity solutions with customers before scaling.,Visualize specifications to include in your scaled solution. ,Learn if customers will pay before scaling the solution. ,Generate demand and validate desirability at a smaller scale. ,Test a video of your solution with a small customer group. ,254-259, Comprehension
7
+ MC,,1,How could a Letter of Intent (LOI) be used to evaluate key partners and B2B customer segments effectively?,3,A Letter of Intent is ideal for interviewing partners and suppliers. ,A Letter of Intent is ideal for creating life-sized prototypes. ,"A Letter of Intent is ideal for evaluating key partners and B2B customer segments as it is a short, non-binding contract that helps articulate key activities or resources needed.",A Letter of Intent is ideal for conducting presales to customers. ,A Letter of Intent is ideal for testing single feature MVPs. ,294-299, Application
8
+ MC,,1,Identify the key requirement for conducting a successful Split Test according to the textbook.,1,A significant amount of traffic is needed to generate believable evidence in a Split Test.,A limited amount of traffic is necessary to achieve meaningful insights. ,A small amount of traffic is adequate to produce valid outcomes. ,A moderate amount of traffic is sufficient for reliable data in a Split Test. ,A minimal amount of traffic is needed to ensure accurate results. ,270-273, Knowledge
 
 
uw_programmatic/config.yaml CHANGED
@@ -36,7 +36,7 @@ rulesets:
36
  rules:
37
  - '"Return ONLY a list of 4 incorrect answers. No markdown, no commentary, no
38
  backticks.'
39
- - '"All incorrect answers should be different, but plausible answers to the question.'
40
  - 'If the question references a subject, the incorrect answer should be related to the subject.'
41
  - '"Incorrect answers may reference material from the knowledge base, but must
42
  not be correct answers to the question'
 
36
  rules:
37
  - '"Return ONLY a list of 4 incorrect answers. No markdown, no commentary, no
38
  backticks.'
39
+ - '"All incorrect answers should be significantly different, but plausible answers to the question.'
40
  - 'If the question references a subject, the incorrect answer should be related to the subject.'
41
  - '"Incorrect answers may reference material from the knowledge base, but must
42
  not be correct answers to the question'