To test with an InitialContext you have to first set up a test context somehow then insert your mock/stub object into the the context.

With dependency injection there is no dependency on an InitialContext in your code, so all you have to do is inject your mock/stub implementation of HelloWorld and you are testing.

The reason for POJOs generally is so that you can unit test your code thoroughly and even program using TDD.