Code Challenges & Technical Assessment Tool for Interviews
- Use your own code challenges or license ours
- Use our amazing team of reviewers or your own
Code Challenges - Technical Assessment tools for Recruiting
CVs and LinkedIn profiles only tell half the story.
Take home Code challenges, tech screens, tech tests, technical assessments, they are an intrinsic part of any hiring flow for software engineers.
Take home code challenges can take a variety of forms, they are there to test the ‘all round’ skills of a software engineer, they can take the form of interview questions or code problems that test skills in
Bulb hired 70 developers in 12 months using Geektastic’s assessments, saving 58 days of engineering resource
- 70Engineers hired in the last 12 months
- 44Hours per week of engingeering time saved
- 50%Reduction in time to hire
- 408Technical assessments outsourced
Some of the Geektastic
Code Challenges you can license
|Programming Language||Code Challenge||Duration|
|Python - Core Skills||Word Score Leaderboards||2hrs|
|Python - Core Skills||Columns Challenge||30mins|
|Android - Core Skills||Weather Forecast||2hrs 30mins|
|Java - Core Skills||Word Game||2hrs|
|Scala - Core Skills||Smart Home||1hr 30mins|
|PHP - Core Skills||Word Game||2hrs|
|C++ - Core Skills||Incomplete Sequences||2hrs 30mins|
|C# - Core Skills||Word Game||2hrs|
|CSS/HTML||Landing Page Creation||3hrs|
|Objective C||London Monuments Challenge||2hrs 30mins|
|Swift||London Monuments Challenge||2hrs 30mins|
Looking for a solution to test your candidates’ technical skills?
The best take home code challenges we have seen engage the developer by testing their all round skills rather than their command of some Syntax. The more ‘real world’ they are the better. They might talk to an API and retrieve some flight data (Skyscanner have an excellent challenge that makes you feel like it’s your first days on the job) or pull product from a list and ask the engineer to create a shopping basket (Just Giving GitHub code challenge)
What type of code challenge to use to test your candidates skills?
Open ended or Time constrained?
There is no right or wrong here and if you ask 100 programmers you will rarely get consensus. Should the challenge be time restricted (ie the engineer is given a fixed amount of time to complete the challenge e.g. 2 hours) or should they be given as long as they like?
If you ask candidates they would probably opt for the open ended approach. Our data certainly shows 60-70% will go for a challenge where they have a week to complete it rather than 2 hours. However you need to look a bit deeper.
We see a higher percentage of time constrained challenges completed and returned vs open ended ones. There are three reasons for this
Candidates take a role elsewhere. All too often we have missed out on hiring because the candidate was further down the road with another company and they didn’t get the chance to complete their code challenge with us.
Interruptions. We’ve all been there, we start out with the best intentions, but something unforeseen happens which distracts us and we don’t get round to completing the task.
Fear of of candidates spending even longer than me. All code challenges should suggest a time period to complete, even if you give them a week to complete it in. The trouble is candidates will always fear someone is spending longer than them, giving them an unfair advantage (and quite rightly so, one of our client’s offers 10 day challenges, the suggested time to complete is around 4 hours. We ask that candidates advise how long they take on the challenge when they submit. The average is 11 hours, the most we have seen was a whopping 40 hours (yes a working week!!)
The longer the window of opportunity to complete the challenge the more likely something will get in the way
At Geektastic we have a portfolio of Take Home Code Challenges you can license. They have been created by the in-house team at Geektastic and also by our global community. The Java Code challenges have been created by experts in Java Programming.
We actually wrote a whole blog post about how to create a coding challenge.
Who (or what) does the reviewing?
Of course we are biassed here but humans can still do a much better job than a machine reviewing solutions submitted for programing interview questions. Until Geektastic came along you had two choices.
In-House development teams - time consuming and distracting but in house teams know the skills and where the bar is set better than anyone. Often cited as the main reason for missing delivery schedules in house teams can spend a lot of time reviewing submissions.
Machines running unit tests - to save time companies use platforms to outsource the process. These platforms use algorithmic based challenges which aren’t really testing an engineer’s skills but whether they know the algorithm. These challenges need to be able to me marked by a machine.
But now you can have the best of both worlds. You can use the highly talented on demand Geektastic review team. All of them have aced a Geektastic Take Home Code Challenge (eg the Java Word Game or the iOS monuments challenge) which was reviewed by one of our UberGeeks (our review team) and also carried out a number of test reviews to make sure their reviewing skills are as good as their problem solving skills. We also want to make sure they we can give constructive, non opinionated analysis and feedback on a candidate’s code challenge submission.
Want a FREE TRIAL to see how impressive our reviews are?
So why use Geektastic?
Flexibility - you can create your own challenges or license ours, you can use our team of reviewers or your in-house teams (but no machines!!)
Candidate First - we designed Geektastic from a developer’s point of view. Our code challenge review tool pushes the analysis back to the candidate so they can see where they did well and just as importantly didn’t go well. If someone is going to spend 2 hours on their solution the least you can do is provide them feedback on the review. No-one wants to hear they didn’t get the role with no reason.
Removing Unconscious bias - all our challenges are reviewed anonymously. This means the reviewer knows nothing about the candidate when they carry out the review.
Expert review team - we have an experienced team of reviewers who adhere to a strict code for reviews ensuring consistency and a high level of quality. If we review your own challenge you can append review guidelines for us to follow to ensure we match the standards of your in-house development team.
Looking for information on a particular language? Check out our insightful pages here
Looking for a platform to manage your technical assessments?
As always if you have any questions or what to arrange a demo or discuss pricing or commercials drop us an email at [email protected]
Frequently Asked Questions
So what is Geektastic? I hear it’s more than a technical assessment platform
Let’s face it - the current process for hiring software engineers has (lots of) room for improvement.
At its core Geektastic is a platform that manages code challenges. We believe a candidate is worth more than a score and humans perform much better reviews than machines.
There is more to coding than solving an algorithm.
We help employers and recruiters assess the technical skills of software engineering candidates through deeply insightful, code challenges.
We have built our own unique bite-size Express Code Challenges for our developer community to enjoy before they commit to taking our 2 hour Peer Review Take Home challenges.
We also help match developers from our community with employer’s roles. Because our community take code challenges to complement their profile they can show off their skills to potential employers.
The very best engineers in our community (those that ace our code challenge with 4-5 stars across the board) join our well paid UberGeek Review Team and earn a secondary income reviewing code challenges in their spare time (£25 per 30 minute review).
Our UberGeek review team also approve express code challenges which have been created by the community just to make sure they are 100% - we pay £10 for each express code challenge reviewed and published.
What programming languages does Geektastic cover?
How secure is my data on Geektastic?
We are fully GDPR compliant. We operate a fully secure platform using SSL encryption and we never store your passwords in plain text.
All developer profiles are anonymous, as a developer you join and create a profile. You can use OAuth like Google or Github to authorise the application or you can use a local username and password.
I am a developer, please tell me how Geektastic works?
So why should I join Geektastic as a Developer?
Good question! We welcome developers from all over the world to join our fast growing community. As you might have gathered we are trying to change the way software engineers are hired.
There are a number of reasons you should join
- You can earn a secondary income doing code reviews in your spare time. We pay £25 per 30 minute review peer review and £10 per express code challenge review.
- You can be fast tracked for some amazing software engineering roles, whether you are looking for an office based role or you want to work as part of a remote/distributed team.
- You can benchmark your skills against a global developer community. We show you where you compare to other developers in our global community.
- You can create and share Express Code Challenges with our community. Once you have taken a couple you an start to create your own. We have created some guidelines you can read here.
I’m sold. So what’s the process for a Developer joining Geektastic?
- To benchmark your skills, to join the paid review team team or get fast tracked to a great new role you’ll need to complete around 20 Express Challenges per language (these take an average of 1-2 minutes to complete.
- If you are keen to join the paid review team you’ll need to get in the top 5% of the global community. You will then be issued with a peer review code challenge - we use these to assess your all round programming skills, if you ace the peer review you are in the paid review team.
- If you are looking for a new role you will need to set yourself to ‘actively’ or ‘passively’ looking. This will mean you start matching with roles on the platform. We have signed an exclusive partnership with a tech recruiter called Third Republic. Our matchmaking algorithm start the process of matching you with roles but their expert team will then manually review your profile to ascertain whether you are a good fit for the role. You can apply to them directly if you see a role you like the look of, also they will be in touch with you to see if you are interested in anything they think is a good match.
What type of roles do you have posted on the platform?
How do I take a peer review code challenge to try out for the review team?
First you have to complete 20 Express Code Challenges in a given language. These are the multiple choice challenges created by our expert team of reviewers and members of the community who have a high enough rating to become an author. Score well in the Express Challenges to unlock your qualifying Peer Review challenge. We are looking for a developer to rank in the top 5% globally before we can open up a peer review.
Can I share my review with companies who aren’t yet on the Geektastic platform?
Of course. You’ll be investing sound 30 minutes on our Express Challenges or 2 hours of your precious time completing one of our peer review code challenges.
You can then share your public profile which shows off your results.
You can post it on your LinkedIn profile, Personal Website or create a QR code and tattoo it to your arm if you like.
We hope that prospective employers will use that instead of asking you to take another tech screen.
How can I become a reviewer on Geektastic?
What steps do I go through?
What step do I go through?
We have a number of steps to becoming one of the review team. For obvious reasons we have to be very thorough (clients expect our team to the same quality as their in-house team).
- First you need to register and validate your email (1 minute)
- Create a profile - we are mainly interested in your core programming languages so we can allocate you the appropriate qualifying challenge (2-5 minutes)
- Complete some Express Code Challenges to show us your skills. These take around 1-2 minutes each. You will need to complete up to 20 challenges (this is how we obtain a true ELO score).
- If you get in the top 5% you will open up a peer review qualifying challenge.
- Take one of our peer review qualifying code challenges (2 hours).
- Our review team will then thoroughly evaluate your solution and provide you a detailed review (we aim to have this back in 24-48 hours)
- If you get voted to join the team (you’ll need to be be getting 4-5 stars across the board to be voted in) we then ask you to carry out two dummy reviews as we need to make sure your reviewing skills are as awesome as your coding skills - we do give you some guidance to help you understand what we look for in a reviewer (this takes approx 1hour)
- Assuming your reviews are up to scratch you are upgraded to Ubergeek Review team status, we’ll add you to Slack and you’ll start to receive messages from the system inviting you to carry out reviews. We pay you £25 for each peer review you perform and £10 for each express challenge you approve. We accrue all reviews and pay you the amount due at month end - either by bank transfer if you are in the UK or by Wise, Revolut or Payoneer.
- Once you are in the team we’ll add you to our Slack group, this notifies each team (JS_Ubergeeks for example) when a new solution has been submitted or Express Challenge has been created which needs reviewing.
- You can pick up as many or as few as you like, we don’t have a minimum you need to complete in a week or month, we also don’t guarantee how many you’ll be able to review as we are beholden to our clients’ candidates submitting. Some of our Ubers did write an answer someone posed on Quora on this point. All we ask is you complete a review within a few hours of starting it so we can get the results back to the candidate who will be waiting.
- Oh and lastly, we’ll send your UgerGeek T-Shirt and decal.
Sound exciting? Register to become an Uber Geek today Register now
Why should I join Geektastic to carry out code reviews?
Geektastic is a great way to earn a secondary income. You choose when you work and for how long. We pay you a flat rate for reviewing candidate’s submissions straight into your bank account at the end of the month. You also get to collaborate with other Uber Geeks. We call it earning and learning.
Can I work from home?
Of course, that’s the great thing about Geektastic, you can work from wherever you like.
Can I join the UberGeek Review Team from outside the UK?
We have Uber Geeks from all over the world, from Argentina to Australia, LA to Beijing.
I specialise in a programming language not covered by Geektastic?
We are always looking to add new programming languages. Please email [email protected]with your details, and your chosen language and we’ll be in touch.
Do you have a cap on how many challenges I can review?
You are limited by the number of challenges the platform creates for you to review. There are client generated solutions (i.e. where they have invited a candidate to take a Geektastic challenge) or where a developer has joined our platform. As all challenges are anonymous you will not be aware of which type you are reviewing. The volume of challenges is driven by the number of clients inviting candidates, the number of developers joining the platform and how many other UberGeeks there are doing the reviews. Please note this is not a full time role as demand fluctuates.
Why is Geektastic the best technical assessment platform?
How much does this amazing service cost?
Prices start at £250 per month - no annual fees, you can pay everything monthly (or €300 or $375)
Each review done by our review team is £50 per review (or €60 or $70)
You can license our challenges from just £20 per month (or €24 or $30)
All our pricing can be found here Geektastic Pricing,
Does Geektastic use machine based automated candidate testing?
Nope. We use real human reviewers to perform our reviews. Please have a read of this blog post for more on our thoughts about how to perform code challenges
How long does it take to review a candidate’s code challenge submission?
Most come back the same day. We aim to complete all reviews in 24 working hours but when throughput volume is high we can take up to 48 hours to respond.
Do you integrate with third party ATS platforms?
You’ll need any account with both Geektastic and Greenhouse/Workable to operate our code challenges on their platform.
Once you are ready to start sending out invites you just request and API key and send it over to your ATS provider (with Greenhouse you send it to your account manager, with Workable they provide a self service interface on their website)
After they are connected you can then invite your candidates and view the results directly from your ATS.
Can I try before I buy?
Yes, we offer a free trial to test out our assessments before you buy. You can have two free assessments on the house.
Would you like to test out a Geektastic code challenge on a candidate for free? Register now
How do candidates take the challenges?
Before you can invite your candidate you need to register as a Hirer and either license a Geektastic Challenge or create a custom code challenge.
You then invite them to take a challenge by entering their email, first name and surname and the challenge you want them to take into Geektastic.
The system automatically triggers an email to the candidate asking them to take part in the challenge.
Each challenge usually requires certain tools such as an IDE to be set up on the user’s machine in advance of the challenge (the challenge instructions warn them about this prior to the clock starting to tick away).
The candidate also needs to find a time window (usually two hours) where they can log into the platform and carry out the challenge. Once they have completed the challenge they upload their solution as a zip file.
Can I use my own challenges rather than the Geektastic challenges?
Yes, you can upload your own challenges using our code challenge builder tool. These challenges remain private and will only be used by you on your candidates.
Can you help us grow a more diverse team?
All our reviews are completely anonymous. The reviewer has no idea who they are reviewing - this means they can be completely impartial.
Removing unconscious bias is crucial in recruitment flows. If the same team that carry out the review carried out the initial phone screen or first round of interviews they will have started to build up opinions, both conscious and unconscious - there is a risk that these will flow through to the review they perform on the code challenge submission.
Using Geektastic’s platform removes the risk of these biases affecting the review.
Do my candidates remain my candidates?
You have spent a lot of time sourcing and wooing your candidates. When you invite them to take a code challenge on our platform they remain ringfenced to you.
They do not register on the platform, they do not create a profile - they simply come to the platform to take a code challenge and receive their review.
I've been invited to take one of your code challenges, what next?
I am applying for a job and have been asked to take a Geektastic code challenge
You will receive an email from the system which contains instructions detailing what you need set up on your machine (this varies depending on your technology stack) and how long the challenge will take to complete.
Once you are ready you follow the link in the invite to our site.
Once at Geektastic you can choose to start the challenge when it suits you.
All challenges are carried under time limited conditions (some are 2hours, others you can spend as long as a week working on your solution). Once you are ready to go you hit the ‘start challenge’ and the challenge is revealed.
Once completed you upload your challenge solution in a .zip file.
Are your challenges time constrained?
Yes, all challenges have a fixed time - otherwise they could run forever and that’s not good for anyone. They tend to fall into two categories, short time constrained challenges (usually 1-3hrs) or what we call ‘open ended’ (but what we mean is you have a week to 10 days to complete the challenge).
Before you start your challenge it will let you know how long you have to complete your challenge. Please give yourself enough time at the end of the period (i.e. when the clock starts going red on the page) to zip up your solution and upload it to the platform so it can be reviewed.
Do I have to use a browser based IDE?
Nope, you can use your own IDE.
We know how annoying it can be to be asked to take a code challenge, let alone have to code the solution is some unfamiliar, browser based IDE which is also recording your every move. That’s a bit like asking someone to take their exam on one of those crazy kneely chairs and use chalk to write your answers on a blackboard
When do I find out the results of the assessment?
We perform a line by line review, star ratings for categories like code quality, solution design and problem solving skills and provide high level summary points, then you receive an email from the system to take you to the review and also allows you to feedback your thoughts on the analysis.
What happens if I don’t complete the challenge in time?
We advise all candidates to submit whatever they have at the end of the period, regardless of whether they have finished or not.
If you don’t submit in time it’s not all over. We do provide clients the tools to open up the challenge to allow you more time to complete it - so if you suffer the old ‘dog ate my homework’ scenario then please contact the person that invited you and they will be able to decide whether to open the challenge up again.
Do you allow multiple submissions?
You can upload multiple submissions during the challenge window. However we always assess the last submission so please ensure the last submission is your ‘final answer’.
What do I do if I have problems whilst working on my code challenge?
Please contact the person that issued the code challenge if you have any issues with your challenge, they can then contact Geektastic support if they can’t resolve the issue.