At your (professional) service

A blog on software professional services and more by Chuck D'Antonio

A skeptic plans a certification program

One of my responsibilities at Acquia is overseeing the development of our certification program. We’re creating this program to establish baseline credentials for working with our commercially supported distribution of Drupal (codenamed Carbon) and our Spokes and Caliper network services. Since Carbon is a distribution of Drupal core and a selection of modules, Acquia certification will judge facility to work with Drupal independent of our distribution.

I was not surprised that the Drupal community is suggesting caution when it comes to our effort and the value of certification in general. I’ve been a certification skeptic since I first started working with Certified™ technical staff. There are too many “paper” certifications in the IT community, and I’m not interested in adding another to the pile. To tell the truth, I’m a bit of a skeptic when it comes to technical training as well—I remember someone close to me telling me so few people failed his classes because “their boss didn’t send them to fail.”

I’ve had to come to grips with my skepticism over the past few years as I’ve had managers ask me to get Certified™ and I’ve developed and delivered training programs. What I’ve realized is that it’s not really about the coursework, the instructor, or the exam. It’s about the student. There are a lot of different approaches certification, and different attitudes to take with you to a training class. There’s also a lot of ways to think about the value of being Certified™.

In any given field, the available talent tends to follow a bell curve. Way over at the right of the curve, certification probably doesn’t add much value. People at this level will either be well enough known, or have a strong enough network, that they won’t need much in the way of outside credentials to establish themselves. Way over at the left, certification probably doesn’t add much value for the candidate (I’m assuming they’d fail), but it does serve to weed them out.

In the middle of the curve is where it becomes more interesting. Here, certifications help distinguish one from the other on an objective scale. The scale is probably not the most important one for selecting an employee or vendor, but it does help to quickly narrow the focus (and thus the effort) for vetting soft skills and other intangibles. The key is designing the scale to minimize the false positives and false negatives.

Robert Douglass, who owns the certification effort on my team, shared his success with Java certification in the Acquia team blog. He used the Sun Certified Java Developer program to organize his efforts to learn Java. Essentially, he moved himself along the bell curve with perspective employers by getting certified. The certification helped two ways—it provided him with a path for his learning and established to the Java community that he had the basis for becoming a successful developer.

How do we design the scale for our certification so that it doesn’t become a “paper certification” (too many false positives)? The key challenge is in identifying what we’re testing for an how to evaluate those skills. As an example, we could test “book knowledge” with questions like:

What is the purpose of hook_enable?
a. install the current version of the database schema
b. perform module setup tasks
c. called before a node is shown on a form
d. defines a set of access restrictions

and with sufficient cramming a certification candidate could pass a test like this with no understanding of what a hook is, or why they’d care. This is a great way to devalue the differentiator by flooding the market with “paper” certifications. This is not the certification we want when we build Yellow Jersey.

I want a certification that tests more than just facts and memorization; an exam that tests the knowledge and wisdom that only comes from practical experience. I have a few ideas about this, but I’m not sure of the best way to go about it. We’ve met with some experts, and I’ve heard a lot of advice about emulating Cisco or Sun. I haven’t studied ether, but I understand that they involve not only multiple choice tests but also a practical component. I think this is necessary, but I’m worried that the cost may be prohibitive in the short term.

I think there’s also a lot we can do in terms of developing the multiple choice questions to probe a deeper level of understanding. Questions on performance, for example, that require the test taker to evaluate a set of requirements against a set of deployment and caching options. Or questions that ask for an evaluation of a segment of code to explain what it’s doing and why.

Keep an eye on the Yellow Jersey to follow how it works out.

0
Your rating: None

13 responses to “A skeptic plans a certification program”

  1. certification

    I like the way this title to a subject. At first I thought it would be very worthwhile to have a certification program, but, as noted repeatedly, “the value is in the eye of the beholder” seems to make sense.

    I still believe that “might” be a good market / desire for it.

    And if it had not, say, 4 levels of certification:

    • Drupal Certified Engineer - Module / Core engineering approach
    • Certificate of Drupal Themer - Track focus only
    • Drupal Designer Certificate - Designed with the chops to design and Drupal
    • Certificate of Drupal Rockstar - a combination of 2 or all of the above

    For me some things in this way it helps to break, as some of these groups would be difficult or impossible for some users not by design, for example. But also, with “levels” or “branches” of certification, including a “super type certificate level” to me can also help drum up interest from some parties.

    I think not, even though being a “company of Drupal certificate” could weigh on the decision to choose this company, there is always the possibility that what makes the “big land” of customers who used to accept less. How to Beat Depression Potential can be found here, I think.

    Submitted by Anonymous

  2. Nice Article

    Really interesting.I think there’s also a lot we can do in terms of developing the multiple choice questions to probe a deeper level of understanding. CNA Training

    Submitted by Anonymous

  3. ultimate wow

    thanks for the article ultimate wow guide

    Submitted by Anonymous

  4. awesome certification

    drupal definitely has a learning curve and having access to a certification program would help many users achla composter

    Submitted by Anonymous

  5. Questions on performance, for

    Questions on performance, for example, that require the test taker to evaluate a set of requirements against a set of deployment and caching options. Or questions that ask for an evaluation of a segment of code to explain what it’s doing and why. SEO Services| Home Security System Reviews| Security Systems|

    Submitted by Anonymous

  6. Drupal training and certification

    What impact will Acquia’s certification program have on other Drupal training.Yellow Jersey · A skeptic plans a certification program tanning beds

    Submitted by Anonymous

  7. I was not surprised that the

    I was not surprised that the Drupal community is suggesting caution of our effort and the value of certification in general. I’ve been a skeptic since certification began working with Certified ™ technical staff. There are too many “paper” certifications in the IT community, and I’m not interested in adding another to the pile.Road Trip

    Submitted by Anonymous

  8. ok

    Thanks for this post, Chuck. At my company everyone has to hold an industry certification, so we’ve got experience with a whole lot of tests. My personal one is the PMP (Project management professional) exam and recurring continuing education credits. Staff hold anything from MCSD/MCAD from Microsoft (multiple tests), ZEND, Java, and even a few staffers have Quark and InDesign certifications. getting pregnant quickly

    Submitted by Anonymous

  9. good luck with the job.

    good luck with the job.

    Submitted by Anonymous

  10. ATOS is not balanced bunch

    ATOS is not balanced bunch with many different interest groups both locally and globally. In some countries, the fight to the quality, because they want to get the correct length and good quality trainers. Regards: Orkut Scraps

    Submitted by Anonymous

  11. certification

    The MySQL certification program is very useful, particularly for us DBAs because it provides a basis for international recognition and of course a pay rise.

    seo company uk

    Submitted by Anonymous

  12. One of my responsibilities at

    One of my responsibilities at Acquia is overseeing the development of our certification program. We are generating this program to establish baseline… denver basement refinishing

    Submitted by Anonymous

  13. I admit that they have hired

    I admit that they have hired a few rare programmers that were certified in something but somehow not competent. Usually they do not have lovely judgement or common sense about problem solving. However, those issues should be identified during a job interview/screening. If we have completed a great job with our hiring efforts, then continuing certification is four way for all of us to measure our progress. applebees coupons

    Submitted by Anonymous