This template is brought to you by Optimizely, a leading experimentation platform.
This template is brought to you by Optimizely, a leading experimentation platform.
Experiment plan and results | Replicating Results of Transformer Fusion Model using Favourita Dataset |
---|---|
Experiment owner | |
Reviewers |
|
Approver |
|
Optimizely link | e.g., https://app.optimizely.com/ |
Jira ticket(s) | |
Status | / / |
On this page |
Add a summary of results here.
Current Roadblock:
|
We hypothesize that DA-RNN with Transfer learning/ Transformer model with Transfer Learning
will decrease MSE/RMSE
because of the incorporation of embeddings
List your primary and second metrics for this experiment:
Use this section to answer questions like:
Where will this experiment run?
Who will see it? e.g., target audience or cohorts
What is the traffic allocation (% in total let in based on targeting)?
A: Control | B: Variation | C: Variation | |
---|---|---|---|
Screenshot | |||
% of visitors/users to see each variation |
Add any baseline data or pre-analysis you have for this experiment. Add planned sample size and time to run.
What feedback or gotchas do you have to share with internal teams (bugs, process or product gaps,etc.)?
Experiment start | e.g., |
---|---|
Experiment end | e.g., |
Link to results in Optimizely | e.g., https://app.optimizely.com/ |
Conclusion | / |
Add a short summary of the metrics below and whether you hit significance.
A: Control | B: Variation |
| A: Control | C: Variation |
| |
---|---|---|---|---|---|---|
Cohort size | ||||||
Primary metric |
|
| ||||
Other metrics |
Primary goal
<Metric> <increased/decreased> <directionally/significantly> by <x%>
Other goals
<Metric> <increased/decreased> <directionally/significantly> by <x%>
What are your key takeaways, questions or observations from this experiment?
What are next steps for you and your team (e.g., Rolling this experiment out to 100%)?