Microsoft’s Virtual Lab Exams: Going Inside the Black Box

Posted by Liberty Munson
Jun 25, 2009 : 08:43 GMT
Filed under Exams, Train & Certification, v-lab
Comments comment email digg twitter facebook live
 
1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.00 out of 5)
Loading ... Loading ...

Microsoft recently announced the release of virtual labs in 83-640. Virtual labs allow you to perform tasks using the software technology rather than performing them in a simulated environment or answering multiple choices questions about how you would solve the specified problem. With virtual labs, you solve the problem by doing something. I found this totally cool video that shows off the virtual lab technology and item type and thought it would be great to share it with you.

Cool, huh? Now, let’s talk a little bit about the experience so you can prepare for these exams.

How do virtual labs work? Virtual labs access virtual machines, which contain the software product (in the case of 83-640, this is Windows Server 2008 Active Directory), over the Internet.

What to expect as a result? Those of you with experience connecting to remote virtual machines know that latency is the nature of the beast; for those of you who haven’t used virtual machines, expect some latency when you take these exams. This means that the mouse may lag behind as you move it across the screen; typing may appear slowly on the screen; screens will take longer to load. We are trying to identify test centers where latency is affecting the candidate’s ability to complete the tasks in the time allotted and will correct these issues to the extent possible. But, we can’t totally remove latency from the exam experience… as I said, it’s the nature of the beast.

Because virtual labs leverage virtual machines, when you schedule an exam you are making a “reservation” on the hosting system. This reservation holds the server space for you to take your exam. As a result, you must start the exam at the time of your reservation. Otherwise, the labs may not be ready for you, or you may lose time because you’ve started late. If the proctor tries to start the exam too early, you will get a “lab not available” warning because the server space is not available yet. We are working to increase the window of time in which candidates can begin these exams, but there will always be limits because there is no such thing as unlimited server space. So, it is a good idea to arrive to these exams on time.

How can you help us improve the user experience? Take a few minutes to complete the survey at the end of exam as well as the survey that you may be invited to complete via email within 48 hours of taking the exam (invite comes from ComScore, our third party survey provider). The first survey focuses on the technological aspects of the virtual lab experience; the second focuses on the effectiveness, appropriateness, and relevance of the exam content. We use feedback from both to drive improvements in our exam process.

So, when will 83-640 be available in your area (because it is a totally awesome way to test real world skills)? Here’s the way roll out works…once enough testing centers in a region have demonstrated that they meet the system requirements to deliver performance-based exams, the region will be considered readied and only the performance-based version of the exam will be available to customers in that region. This means that the test centers in your region may not be delivering the exam yet.

What else do you want to know about these exams? No, I can’t tell you what skills we are testing people on in 83-640 except to say they are skills you use in Active Directory, but I’d love to hear what you’re thinking or wondering about the virtual lab exam experience.


  • If your testing center is not capable of delivering the performance exam, will you to travel to a center that is? I doubt my employer would give a half or whole day off to write an exam and cover over an hour's travel cost both ways.
  • Obel
    I think this is a great way of giving Microsofts certifications more value. With this kind of exams one really has to show that he knows how to deal with the tested technology rather than just learn some answers without ever seen that technology work.

    I am curious: Now that 83-640 is out, what are the plans for other exams? Are you guys already working on replacing some more, if yes, which one will be next?
  • This is one if the most successful ideas for testing, I hope MS can use it on more and more exams other than just windows server ones.

    Also I hope that MS reconsider the idea of questions banks to eliminate any chances for brain dump companies and re-establish a good reputation for MS exams.

    Thanks for the video
  • KB
    Will SharePoint configuration exams be a virtual exam in future?
  • Liberty Munson
    Hi Steven--Before releasing the virtual labs in a particular region, the test centers in that region must demonstrate that they meet our readiness requirements. As a result, it's likely that your nearby test center will also be delivering this version of the exam WHEN it's released in your region. On the other hand, if you want to take this version of 640 AND it's not yet available in your region, you will have to travel to a location that does. The test centers in your region will continue to deliver the traditional version until we can transition most of the test centers to the virtual lab version.

    That being said, if you live near a test center that no longer offers 640, it means that the test center isn't able to deliver 83-640 although it's available in your region. If that's the case, send me the location of this test center, and we'll work with Prometric to get that center readied.

    By the way, if you don't see 70-640 in English or when you're registering, you need to scroll down the page...once the virtual labs are available, you need to register for 83-640.
  • Liberty Munson
    Hi KB--our goal is to add performance based items to as many of our exams as possible. However, we don't currently have a schedule for transitioning the SharePoint exams.
  • Took the 083-640 on Monday, June 29th, and passed.

    The 2nd Virtual Lab "lost connection" and unsuccessfully attempted to "restablish connection" until the proctor (who was very friendly and accomodating, although I did have to let him know that the new 083 series was using remote, virtual labs) called his support and they told him to reset the client. I lost almost 15 minutes when it reconnected (went from just under 40 minutes to just under 25 left). I got a little frustrated and decided to just move on to the next part. I'm sure that's why I didn't break 800, but I did, at least, pass.

    The post-exam questionaire asked several thingsabout the virtual labs and the traditional portions, including if one became unavailable and how it was handled. All-in-all it was an experience. I know Novell has used the same virtual approach for years now. I assume this is a Prometric design/implementation detail?

    In fact, I was curious what "back-end/tunnel" was used, because it was using NTLM authentication (with a manual override, no automatic trust/setup), which makes me question 2003R2 or 2008 Federated Services are actually being utilized? In fact, the picker and "latency feel" is more like a framebuffer (e.g., VNC) than RDP/ICA. But I could be wrong.
  • Liberty Munson
    Hi Bryan,

    Thanks for sharing your experience and completing the end of exam survey. We are doing everything we can to improve the user experience with virtual labs. One challenge is identifying test centers that are having problems delivering the exam. If you let me know where you took the exam, my team will work with Prometric to improve the experience at that location.

    To your tunnel question... unfortunately, this is one of the things that I can't tell you. First, I don't completely understand it--it's magic as far as I can tell; but, more important, this state of the art technology and considered proprietary. So, we'll just go with the "it's magic" idea. :)
  • Liberty Munson
    Hi Obel,

    Yes, we are planning to add virtual labs to other exams. We are still in the planning phase, though, and haven't chosen the next exam. Because these labs take a lot of resources to develop, we are trying to identify the exams where they will have the most impact. Eventually, we hope that they will be part of nearly all of our certification exams.

    We definitely believe that this is the wave of the future for our certification exams and are doing everything we can to get them added to as many exams as possible as quickly as possible.
  • Beetle
    Today, July 8th, is the THIRD time that I've attempted to take exam 083-640 at Prometric in Purchase, NY.
    Every time the "Launch Lab" button is clicked to start the exam, it fails with a "UTD-23" error.
    I'm sure you understand the amount of wasted time and effort involved so far.
    Finally, Prometric's level 2 support suggested trying a different test center as they couldn't guarantee this test would work at the Purchase location for another 30 days.
    This is very frustrating - how thoroughly was this exam environment tested before going live?
    Please reply to the above email address.
    Thanks,
  • Liberty Munson
    Hi Beetle,

    I am following up via email.
  • Sheba
    The testing station in Tacoma is unable to launch this exam. Everytime they attempt the virtual part of the exam is unable to load, and eventually loses connection.
  • LK
    I did try today (in Bulgaria) the test 83-640 but first it couldnt load. The software gave no errors, just "contact Helpdeks". My test center contacted Prometric and after 1 hour they told me i am ready to take it. Unfortunately again there was trouble. The LAB couldnt connect to server, said connection lost no matter what we did. My Test center again contacted Prometric and they suggested to take the test again and (Prometric told me on phone) to re-think if i want to take in another center.. Anyway , i lost more than 2 hours and test is re-scheduled for Monday. Lets hope it would go ok. One thing i cant understand is, why nobody understands why these problems exist ;) Or at least there should be better documentation for the test centers, to be prepared when this happens.
    Otherwise Good work with the exam.I think thats the future - virtual practise, not just test questions.
  • pragati2010
    What are the resources/tips to pass a microsoft exam(70-441)
  • pragati2010
    Someone can tell me the resources to pass a microsoft certification exam .
blog comments powered by Disqus