The CICD Dilemma

Agiletestware works with a variety of engineering organization all over the world. It is always enlightening to see how different organization implement quality engineering discipline and try to achieve CICD (continuous integration and continuous delivery). Our experience shows that CICD is a long journey and requires a great amount of experimentation, discipline, and custom integrations with a variety of tools and frameworks. There is no silver bullet that will get you to the promised land 😢 CICD takes time, patience, and a good vision 😇

Many of our customers use a wide variety of testing frameworks, tools, CI systems, ALM solution, bug trackers, requirement management systems, etc. All of them want to achieve CICD but integrating all these technologies is a very challenging task when you need to do your day job and ship features to customers.

In these series of blog posts, we will go over how many of our customers have come one step closer to achieving CICD. The blog posts will explain how a variety of testing frameworks and tools and have been integrated with HP ALM (our customer’s ALM software for tracking projects) using Agiletestware’s Bumblebeeproduct.

The typical technology landscape at most large companies

Before we explain the solution, let us explain the typical setup found in many of our customers. Hopefully, many of you will relate to this situation.

CI Applications – Jenkins, Bamboo, and TeamCity

CI system are at the center of achieving CICD. The three biggest and most mature CI applications are JenkinsAtlassian Bamboo, and Jetbrain’s TeamCity. CI systems are used to build software, run tests, and do a variety of other tasks. In mature engineering organizations, CI systems are used to deploy software to achieve CD. All the information about these various tasks (build, test results, etc) are contained within the CI application.

What is HP ALM?

HP ALM is the leading solution in the industry for tracking complex software project. HP ALM is used for bug tracking, requirements management, test case management, and much more. HP ALM is a commercial product and integrates with various other tools from HP tools for testing web, mobile, and various other software products.

Web Testing and Selenium WebDriver

Selenium Webdriver is an open source tool for automating browsers. Primarily, it is for automating web applications for testing purposes. Selenium has the support of some of the largest browser vendors who have taken (or are taking) steps to make Selenium a native part of their browser. It is also the core technology in countless other browser automation tools, APIs and frameworks. If you are not using Selenium for testing web applications, you should re-think your testing tool strategy and take a closer look at Selenium WebDriver 😀

Mobile Testing and Appium

Appium is an open source test automation framework used for testing native, hybrid and mobile web apps. Appium aims to automate ios, Android, and Windows mobile app from any modern programming language and any test framework. Appium is supported by SauceLabs (leading provider of web and mobile test cloud). Appium is most widely used mobile testing framework and is free.

JAVA Test Frameworks – testNG and JUnit

Testing tools like Selenium and Appium require some test framework. In the JAVA world, two of the most widely used test frameworks are JUnit and testNG.

JUnit: JUnit is a simple framework to write repeatable tests. It is an instance of the xUnit architecture for unit testing frameworks.

testNG: TestNG is a testing framework inspired from JUnit and NUnit but introducing some new functionalities that make it more powerful and easier to use.

All sounds simple. So what is the problem?

If you are a HP ALM shop and using HP tools (UFT, LeanFT, QTP, etc) for testing all your applications, then there are no issues and life should be good. Every software development and testing activity should nicely be reflected in HP ALM.

However, the reality is that most organizations are rarely a homogeneous HP shop. Some teams may be using HP Tools (UFT, LeanFT, QTP), mobile testing team may be using Appium or other similar open source tools, browser application testing teams may be using Selenium WebDriver and cloud browser solutions like SauceLabs and BrowserStack, API testing team may be using using ReadyAPI, and unit test is hopefully done via some x-unit framework like Junit or testNG and most of these activities are controlled via Jenkins/Bamboo/TeamCity.

The end result is that you end up with islands of information within your organization. Some information is in HP ALM and some is in Jenkins/Bamboo/Teamcity and it is impossible to get a unified view of the project. As a consequence, engineering management often makes an uninformed decision because they don’t know how to collect all the data. There are just too much human element, too many reports to prepare, and it is just a pain and no one wants to do this.

How can Agiletestware help?

Agiletestware has been helping engineering organizations achieve CICD through many of our tools. We can’t solve all your problems but we may be able to solve many of them to get you closer to CICD. HP ALM is a significant investment and you should get the most out of your investment. We believe HP ALM is still the best ALM solution in the market and has the most mature bug tracking, agile project management, requirements management, and test case management modules in a single solution.

Agiletestware’s Bumblebee product can help integrate CI applications like Jenkins/Bamboo/Teamcity, JAVA tests frameworks like testNG/JUnit, and web and mobile testing tools like Selenium WebDriver / Appium with HP ALM with little to no coding. Bumblebee simply intercepts activities within your existing testing tools and CI frameworks and exports it to HP ALM in real-time.


I am the founder of Agiletestware. I have been working as a Quality Engineering engineer, manager, architect, and consultant for about 10+ years in Los Angeles, and San Francisco. I have worked with a variety of test frameworks, test infrastructure automation strategies and tools, and various ALM and test case management applications. If you need advice on how to make your teams and processes efficient, transparent, and how best to integrate testing into your CICD strategy, shoot me an email and I would love to chat.

20 thoughts on “The CICD Dilemma”

  1. Hey, how’s it going?

    I want to pass along some very important news that everyone needs to hear!

    In December of 2017, Donald Trump made history by recognizing Jerusalem as the captial of Israel. Why is this big news? Because by this the Jewish people of Israel are now able to press forward in bringing about the Third Temple prophesied in the Bible.

    The Jewish people deny Jesus as their Messiah and have stated that their Messiah has been identified and is waiting to be revealed. They say this man will rule the world under a one world religion called “spiritualism”.

    They even printed a coin to raise money for the Temple with Donald Trumps face on the front and with king Cyrus'(who built the second Temple) behind him. On the back of the coin is an image of the third Temple.

    The Bible says this false Messiah who seats himself in the Third Temple will be thee antichrist that will bring about the Great Tribulation, though the Jewish people believe he will bring about world peace. It will be a false peace for a period of time. You can watch interviews of Jewish Rabbi’s in Israel speaking of these things. They have their plans set in place. It is only years away!

    More importantly, the power that runs the world wants to put a RFID microchip in our body making us total slaves to them. This chip matches perfectly with the Mark of the Beast in the Bible, more specifically Revelation 13:16-18:

    He causes all, both small and great, rich and poor, free and slave, to receive a mark on their right hand or on their foreheads, and that no one may buy or sell except one who has the mark or the name of the beast, or the number of his name.

    Here is wisdom. Let him who has understanding calculate the number of the beast, for it is the number of a man: His number is 666.

    Referring to the last days, this could only be speaking of a cashless society, which we have yet to see, but are heading towards. Otherwise, we could still buy or sell without the mark amongst others if physical money was still currency. RFID microchip implant technology will be the future of a one world cashless society containing digital currency. It will be implanted in the right-hand or the forehead, and we cannot buy or sell without it! We must grow strong in Jesus. AT ALL COSTS, DO NOT TAKE IT!

    Then a third angel followed them, saying with a loud voice, “If anyone worships the beast and his image, and receives his mark on his forehead or on his hand, he himself shall also drink of the wine of the wrath of God, which is poured out full strength into the cup of His indignation. He shall be tormented with fire and brimstone in the presence of the holy angels and in the presence of the Lamb. And the smoke of their torment ascends forever and ever; and they have no rest day or night, who worship the beast and his image, and whoever receives the mark of his name.” (Revelation 14:9-11).

    People have been saying the end is coming for many years, but we need two key things. One, the Third Temple, and two, the technology for a cashless society to fulfill the prophecy of the Mark of the Beast.


  2. I feel this is among the so much important info for me. And i am happy reading your article. However should statement on few general things, The website style is perfect, the articles is in point of fact nice : D. Excellent activity, cheers

  3. “The capitalist countries must have a strong force from the highest leadership, and declare the income\/wealth/opportunity gap is a national emergency and assume the responsibility of redesigning the system so that it can function better.

  4. so it is entirely possible for the Fed to quickly reverse the dovish position held since the beginning of 2019. O’Neill said any signs that the Fed is tightening monetary policy will disrupt the US stock market and bond market.

  5. Pingback: Nike Shoes
  6. Trump, who has nearly 60 million followers on the service, complained about losing followers back in October after Twitter purged a number of suspended accounts, resulting in a decline of followers across the political spectrum, with Trump losing 200,000 and former President Barack Obama losing 2 million.

  7. Together with almost everything which appears to be developing within this subject material, many of your opinions are somewhat radical. However, I am sorry, but I do not subscribe to your whole strategy, all be it exhilarating none the less. It looks to me that your comments are not completely rationalized and in actuality you are generally yourself not wholly confident of your argument. In any case I did enjoy looking at it.

  8. Also joining the podcast is Alexi Lalas, the former U.S. national team player and current Fox Sports soccer analyst, who talks about the use of instant replay in the game and previews the Champions League matches next week. Lalas also weighs in on the MSL and its latest expansion plans.

  9. Hello just wanted to give you a quick heads up. The words in your article seem to be running off the screen in Safari. I’m not sure if this is a formatting issue or something to do with browser compatibility but I thought I’d post to let you know. The style and design look great though! Hope you get the issue resolved soon. Many thanks|

  10. I was suggested this web site by my cousin. I am not sure whether this post is written by him as nobody else know such detailed about my trouble. You are wonderful! Thanks!|

Leave a Reply

Your email address will not be published. Required fields are marked *