Frequently Asked Questions & Troubleshooting

Job Dashboard

Reports  

Predictions & Accuracy 

Job Dashboard

 

What do predictions look like?

Not enough candidates 

  • We're not able to make a prediction until a job has at least 1 candidate. Add a candidate to this role to see a prediction! 

Screen_Shot_2018-04-17_at_3.07.50_PM.png

No Status

  • You haven’t set a Target Start Date yet. Have a Site or Job Admin click ‘Set Target Start Date.’

Screen_Shot_2018-04-17_at_2.44.36_PM.png

On track

  • Your Predicted Start Date falls before or the week of your Target Start Date. You’re on-track to make a hire by your target!

Screen_Shot_2018-04-17_at_2.46.45_PM.png

Heads up

  • Your Predicted Start Date falls after the week of your Target Start Date. You’re not on track to make a hire by your target and should consider adding more quality candidates to your pipeline.

Screen_Shot_2018-04-17_at_2.52.57_PM.png 

Not confident 

  • We only display a prediction on the Job Dashboard if it meets certain accuracy standards. Check back later when we've had more time to crunch the numbers. 

Screen_Shot_2018-04-17_at_3.46.47_PM.png

Error 

  • One of our internal systems powering Greenhouse Predicts is not working properly. We have monitoring in place to let our engineers know when there is a problem and we’re working on getting predictions back up and running!

Screen_Shot_2018-04-17_at_4.21.51_PM.png

 

Who can see predictions on the Job Dashboard? 

Any Job Admins on the job will be able to see predictions on the Job Dashboard. Only Job Admins with the permission 'Can edit job info' will be able to set Target Start Dates. 

 

My Predicted Start Date range is always 4 weeks long. Will this range get shorter and more accurate over time?

We make predictions for the offer acceptance date because there is usually less variability for when someone will accept an offer than when they'll be able to start working. For example, a candidate might need to relocate, wait for a visa, or give notice to their current company. All of these factors make it harder to accurately predict a start date

Therefore, we predict the week a candidate is likely to accept an offer. Then, we give you a start date range that is always a fixed timeframe of 4 weeks, starting 2 weeks after our predicted offer acceptance date. This range will not get shorter over time, but you can use it as a guide for when to expect a new hire to start. 

 

How do I know which job opening the predictions are for?

 We currently only make a prediction for one opening at a time on a job.

We can confidently make a prediction for one hire based on the job's pipeline, but our accuracy would significantly decrease if we tried to predict for two or more hires from the same pipeline. We'd be using the same pipeline to make predictions, but trying to determine multiple outcomes which would increase variability and lead to less-precise predictions. 

If you have more than one opening on a job, you can still set multiple Target Start Dates. We’ll make a prediction for the opening with the soonest Target Start Date. Once you make a hire, we’ll start predicting for the next opening on that job right away!

Reports 

 

How often are predictions in the Job Status report refreshed?

Predictions are updated in the Job Status report every 12 hours.

Any time you view a prediction on the Job Dashboard, we first have to request a new prediction from our API. This means that we’re doing a new calculation each time you visit the Job Dashboard, and running this equation can take some time. Because of that, we don’t automatically update predictions in the Job Status report. Otherwise, this report would load very slowly. Instead, we'll display the most recent prediction we made for that job. We'll then display new, updated predictions 12 hours later. 

 

The prediction on the Job Status report doesn’t match the prediction on the Job Dashboard!

Because the predictions on the Job Status are updated every 12 hours, it's possible that the prediction on the Job Dashboard and in the report might not be the same. 

 

I moved a bunch of candidates to the onsite stage and the prediction on the Job Status report hasn’t changed!

It’s possible that the actions you took on a job (e.g. moving candidates to another stage or adding new candidates) will change your prediction. However, we might not have generated or stored an updated prediction for that job on the Job Status report yet. The new prediction should appear in the report in about 12 hours. In the meantime, you can see the most up-to-date prediction for that particular job on the Job Dashboard.

 

I opened a job and it doesn’t have a prediction in the Job Status report. Where is it?

If you open a job and immediately check the Job Status report, it’s possible that we haven’t generated or stored a prediction for that job yet. If you first go to the Job Dashboard and view the prediction there, and then check the Job Status report, the prediction should appear.  

 

My Job Status report is only show predictions for one opening. Where are the predictions for the other 99 openings on my job?

We currently only make a prediction for one opening at a time on a job.

If your job has multiple openings, the Job Status report columns for ‘Predicted Start Date Start,’ ‘Predicted Start Date End,’ and ‘On Track to Target’ will only populate for one opening at a time. For any other openings on that job, those columns will be blank.

See How do I know which job opening the predictions are for? for more information. 

Predictions & Accuracy

 

How accurate is the prediction I'm seeing?  

On average, 80% of the time, our predictions are within 3 weeks of true time-to-next hire. 

Because Greenhouse Predicts was built using machine learning, predictions will continuously improve and become more fine-tuned to your company over time as we get to know your hiring habits.

Additionally, we're actively evaluating and testing new model inputs that will increase the accuracy of our predictions.

 

Why is my screen is showing a different prediction than my team member’s?

Because we use machine learning to make predictions, there is a chance that the equation can weigh factors slightly differently each time we run this calculation (i.e. anytime you view a prediction on the Job Dashboard).

When you look at your Job Dashboard, and someone sitting next to you looks at the same Job Dashboard on their computer, we're actually running two different calculations. 

This means that our predictions might bounce around a little bit from week to week (especially if the prediction is right on the edge of the end of one week and the beginning of another week). This can cause some variability in the prediction you might see on your screen.

 

Why does the prediction jump forward or back a week just by changing the Target Start Date? 

Because we use machine learning to make predictions, there is a chance that the equation can weigh factors slightly differently each time we run this calculation (i.e. anytime you view a prediction on the Job Dashboard).

This means that our predictions might bounce around a little bit from week to week (especially if the prediction is right on the edge of the end of one week and the beginning of another week). This can cause some variability in the prediction you might see on your screen when the Greenhouse Predicts widget refreshes after setting a Target Start Date. 

 

Does setting a Target Start Date impact my prediction? 

No, we will still make predictions for a job even without a Target Start Date. Setting a Target Start Date will not impact the predictions, but you won't get an "on track" or "heads up" status until you set one. 

 

Why can't I see historical predictions? 

We do not store historical predictions over time in Greenhouse. If you'd like to track how predictions change for your roles over time, we recommend scheduling and sending the Job Status report weekly. 

Have more questions? Submit a request