Detailed Notes
Welcome, if you are a tester or developer interested in automation testing or are new to test automation tools than you defiantly need to check out TestProject. However, if you are not familiar with this tool that's OK. In Test Project A Review of Version 2.0 we cover all the new features in Test Project 2.0 as well as walk you through using the tool to setup your first test.
Test Project A Review of Version 2.0 Overview:
What is Test Project What's new in Version 2 Overview of the tool Creating your first test case What is Test Project?
TestProject is a community driven tool and has a free forever plan that is fully featured and that you can get started with in moments. In addition they have a lot of documentation that will help you with all the details you need to use TestProject to create effective test automation that your whole team can use. What Makes Test Project Unique?
First of its kind community powered test automation framework. Second its 100% free test automation development framework designed for agile teams! Advanced built-in recording capabilities AI-Powered self healing technology built in. It seamlessly supports iFrames, Popups and Dynamic Elements. With built in Adaptive-wait technology it automatically handles deviations in web application loading times. Also supports both hybrid cloud and completely offline modes Has a CLI Agent. Finally, it's free forever for anyone to use. Start with a new account:
Create a new account or connect to an existing google or microsoft account.
Install & Register
First start by downloading the TestProject tool. Then, install the TestProject tool on your machine. Finally, make sure the tool is up and running. Make sure your os security settings allow test agent to access your machine
Additional Resources
Hybrid Cloud and Offline Mode https://docs.testproject.io/getting-started/hybrid-cloud-and-offline-mode Understanding Test Files https://docs.testproject.io/getting-started/hybrid-cloud-and-offline-mode/understanding-test-files Using AI to Improve Testing https://docs.testproject.io/getting-started/using-ai-to-improve-testing Finally, this series comes from our mentoring/mastermind classes. These classes are virtual meetings that focus on how to improve our technical skills and build our businesses.  After all the goals of each member vary.  However, this diversity makes for great discussions and a ton of educational value every time we meet.  We hope you enjoy viewing this series as much as we enjoy creating it. As always, this may not be all new to you, but we hope it helps you be a better developer.
Transcript Text
[Music] hey guys welcome today we are moving away from react and we're going to start talking about a testing tool i ran across called test project our presentation today we are going to just it's going to be an overview of the test project application what it is what they do and we're going to really look at a lot of the things that they've added since virgin 2.0 came out which uh brought me back to this project because now it's something that is a little more polished a little more production ready in the corporations so this is going to be almost fully hands-on so let me jump out so the first thing is you need to go to test project i o and that will bring up their main website here and it is a free open source automation tool that you can use for a lot of different things you can use it for uh web testing you can use it for mobile testing and what makes test projects so unique is it's the first of its kind where it is 100 open source it's a community powered test automation framework a hundred percent free they do not charge for anything and it is a full test automation development framework designed for agile teams it also comes with advanced built-in recording capabilities which we'll look at today it also comes with an ai powered self healing technology built in so like if your tests break or if you have some loading issues it kind of can tweak and self heal itself it also seamlessly supports iframes pop-ups dynamic elements modals all those nasty things that bite us with selenium or that you have to kind of write your own solutions around it also comes in with a built-in adaptive weight technology so if you remember some of my discussions about the test framework i had to create some custom weight features in order for us to handle the different dynamic weights explicit implicit weights within selenium so they have this built in we'll take a look at that it's kind of cool it also supports hybrid cloud and it also now supports completely offline modes which is brand new with version 2.0 prior to version 2.0 it was completely cloud-based which was great unless you're dealing with a proprietary company or with a company where everything is stored offline or in an offline capacity where it's behind a firewall it also supports a command line agent which is really cool we won't get into that too much today but we'll talk about that in a future class where you can actually export your tests and run them from the command line you can also run them through jenkins hudson or bamboo any of your offline continuous integration frameworks and their goal is to keep this free forever to anyone all you have to do to get started you can either enter in an email and create an account through them or you can use your existing google or microsoft accounts before i log in though let's just quickly go through their website to highlight some of the key places you might want to check out so first and foremost test automation without limits again it's originally started out as a cloud-based testing tool but now they've also given you an offline feature which is very cool with version 2.0 you can basically record your test real time and then you can export them to rerun them locally they also integrate with things like browser stacks sauce labs they have some other executions where you can deploy them through hudson bamboo they have really nice debugging and reporting so you can really see what's failing and how things are working again it works seamlessly online and offline and the other thing i wanted to point out is well they have some navigation here at the top the bulk of the navigation of their website is at the bottom of the site this is where you can quickly find access to anything that you need one of the cool things here is here's a quick list of everything that their test solution covers it will handle web testing android ios testing selenium testing and appium testing now the cool thing here though is ios testing if you go to the little border pier it works even on windows so if you are testing a native ios application you can debug it from a windows application so you're no longer tied to a macintosh in order to do testing of ios devices so that was really cool some other things under platform you have quick links to the mobile test recorder the web test recorder team collaboration this is really cool so not only can you build your test cases for your test groups you can also share these tests across the organization so you can send them to the business you can send them to developers and they can run these tests at will and also have access to all the tools that you have access to again is a fully open source framework which is really cool so if we wanted to contribute we could fix a bug contribute or add a new feature it is bdd testing ready so you can do behavior driven development i'm not a huge fan of that but it is it does support it so for readability for business this is one approach you can take it's also cross-platform testing so you can test across multiple browsers you can test headless you can also push this out to docker and run across a grid like framework it also has command line and continuous integration pipelines remote execution and a bunch of add-ons which i'll briefly cover but i'm not going to get into specifics to that and proven testing solutions so it works with web testing android testing ios selenium and appy the documentation the key thing here i would recommend if you're going to check this out definitely start with creating an account go through installation and setup this walks you through how to install the agent what you might need to do to set security settings so that the agent will actually run on your device and some other things like you know quick getting started and getting started with ios testing so we're actually going to jump in and get our hands dirty right off the get-go so we're not going to worry too much about that but if you want to come back later and check this out this is how you can do it just go under documents they also have some blogs these are really cool they talk about selenium 4 some other things in the community behavior driven development they've got a lot of interesting articles out here check some of those out if you have time they also have an online forum so you can ask questions look and see what issues people are having see if anything relates to what you're doing full online support really good community you can also search their site it's really cool and then you can also kind of look for different things within the site key shortcuts frequently asked questions and so on okay so from the test i o page we go up to log in here so it's going to log me in now i've already installed the agent but in order for the test to work or the test recorder piece to work you have to actually run the agent so right now it's not running so let me kick that off while i talk about the dashboard so when you log into test project for the very first time you're going to see this little interface here and we have things like project monitor add-ons reports agents and integration you also have this new test featured for recording new tests and you also have open file if you want to import tests from your local file system this little icon here indicates if you have an agent running and you can have multiple agents running if you wish so you could have multiple workers if you want to try to run multi-threaded you can also invite people to your project so you can build your project team i have not seen a limitation on this and again this is all free so this is something maybe as a group we might want to play around with it also comes once you first log in for the first time it comes with a pre-built test case so the first thing they recommend you do is once you log in just run this guy see how it works so we'll click run oh okay so to run my test i have to pick an agent so since i only have the one agent right now my first agent i can select that i can do web testing or mobile testing now we're not going to focus on mobile today i'll cover that in the future so when you select web it gives you all the different browsers that are currently installed on your machine so what can the agent work with so i have chrome i have edge i have firefox and i have safari now just a little note safari given the last ios major update for mojave this depending upon your security settings may not work so you may have to reduce your security settings of safari in order to actually run safari tests since most of the world is windows-based or linux-based safari is just mac so most of the other browsers here are where you're going to focus your time so we'll do chrome and then i will hit next so it says override default input parameters or use source data i don't have a data file yet so we'll override the default inputs and what this does is it looks at the test and it says oh you have these three input fields what is the data that you want to enter from them so we have the password 123 john doe and the start url for the test which is going to be examples.testproject.io web then click run and while it's running you can hit show monitor and it will show you all your agents that are running so it's repair and it gives you the status that's preparing the test now since i ran it in the head mode it actually opened up the browser it's walking through it's populating the values and it just walked through and it populated the test page test finish we have a hundred percent so as soon as it's done tearing down this uh agent will shut down so now it's gone so now if i go back over to projects so here's my project i can go here where you see this little graph icon and i can click that and it takes us to the reports for this run so this test ran it took 27 seconds we started it on november 13th the agent we used was an apple agent my first agent so if you actually had multiple machines with multiple agents you could run these across like apple windows linux if you had docker set up you could point it to different dock and on your doctor if you install the agents on each of your docker instances you can point to those instances it shows you the steps that ran and the steps that passed so if anything failed you would see a failure and then you can look at the historical runs of this so i ran this two days ago seven days ago and you can kind of look at the different history of each for instance i tried to run doctor who earlier this morning and it failed so if you look it says hey we had 100 passing on chrome but safari it did not run the agent failed because of the security settings see test no longer exists so i can't actually debug into the test but you could walk into the tests you can look at the summary report which you can export and these are really cool because you can look at the summary report it's very clean has all the information that you need and then you can provide this summary to the business or to the developers or business managers project managers basically say okay here is the results of our test run if you're trying to do some additional debugging or you need to go into you know further detail for development they can look at the full report which not only gives it the summary but it also gives you the execution details as well so here's the full details here's all the steps that ran here's the results and the detail so here we see safari did not run it errored out the agent failed to kick it off one thing you have to be careful of is make sure you do not close your test project tab because then you have to kind of relog in and start over just quick overview of the menu here so we have our test jobs these are all the tests that we've recorded or we've scripted if you're working in an offline state you can click the three dots here and you can actually save your test as a file and if we were to just save it without you can export it as a package but we'll just save it as a file what's interesting about this is it will save it as a yaml file and if we look at the yaml file we see that okay here's all that information that we see at the top of our summary report the project name who created it when it was created but then you have the different steps so your first step here id my first test then in here you have your settings the application again step the action you want to take the parameter mappings so it's kind of like a json file source except it's just a yaml file and but it contains all the information you can configure from this file including data that you can then save and then run through their command line interface or export this to jenkins hudson or whatever and then run this test offline so it's kind of cool that we can do that you
Transcript Segments
[Music]
hey guys welcome today we are moving
away from react and
we're going to start talking about a
testing tool i ran across called test
project
our presentation today we are going to
just it's going to be an overview of the
test project application what it is what
they do
and we're going to really look at a lot
of the things that they've added since
virgin 2.0 came out which uh
brought me back to this project because
now it's something that is a little more
polished a little more production ready
in the corporations
so this is going to be almost fully
hands-on so let me jump out
so the first thing is you need to go to
test project i o
and that will bring up their main
website here
and it is a free open source automation
tool that you can use
for a lot of different things you can
use it for uh web testing you can use it
for mobile testing
and what makes test projects so unique
is it's the first of its kind
where it is 100 open source it's a
community powered test automation
framework
a hundred percent free
they do not charge for anything and it
is a full test automation development
framework designed for agile teams
it also comes with advanced built-in
recording capabilities which we'll look
at today
it also comes with an ai powered self
healing technology built in so like if
your tests break or if you have some
loading issues it kind of can tweak and
self heal itself
it also seamlessly supports iframes
pop-ups dynamic elements modals all
those nasty things that bite us with
selenium or that you have to kind of
write your own solutions around
it also comes in with a built-in
adaptive weight technology so if you
remember some of my discussions about
the test framework i had to create some
custom
weight features in order for us to
handle the different dynamic weights
explicit implicit weights within
selenium so they have this built in
we'll take a look at that it's kind of
cool
it also supports hybrid cloud and it
also now supports completely offline
modes which is brand new with version
2.0
prior to version 2.0 it was completely
cloud-based which was great
unless you're dealing with a proprietary
company or with a company where
everything is stored offline or in
an offline capacity where it's behind a
firewall
it also supports a command line agent
which is really cool we won't get into
that too much today but we'll talk about
that in a future class where you can
actually export your tests and run them
from the command line you can also run
them through jenkins hudson or bamboo
any of your offline continuous
integration frameworks
and their goal is to keep this free
forever to anyone
all you have to do to get started you
can either enter in an email
and create an account through them or
you can use your existing google or
microsoft accounts before i log in
though let's just quickly go through
their website to highlight some of the
key places you might want to check out
so first and foremost test automation
without limits
again it's originally started out as a
cloud-based testing tool
but now they've also given you an
offline feature which is very cool with
version 2.0
you can basically record your test real
time and then you can export them to
rerun them locally
they also
integrate with things like browser
stacks sauce labs
they have some other executions where
you can deploy them through
hudson bamboo
they have really nice debugging and
reporting so you can really see what's
failing and how things are working again
it works seamlessly online and offline
and the other thing i wanted to point
out is well they have some navigation
here at the top the bulk of the
navigation of their website is at the
bottom of the site
this is where you can quickly find
access to anything that you need
one of the cool things here is here's a
quick list of everything that their test
solution covers it will handle web
testing android ios testing selenium
testing and appium testing
now the cool thing here though is ios
testing if you go to the little border
pier
it works even on windows so if you are
testing a native ios application you can
debug it from a windows application so
you're no longer tied to a macintosh in
order to do testing of ios devices so
that was really cool
some other things under platform you
have quick links to the mobile test
recorder the web test recorder
team collaboration this is really cool
so not only can you build your test
cases for your test groups you can also
share these tests across the
organization so you can send them to the
business you can send them to developers
and they can run these tests at will and
also have access to all the tools that
you have access to
again is a fully open source framework
which is really cool so if we wanted to
contribute we could fix a bug contribute
or add a new feature
it is bdd testing ready so you can do
behavior driven development
i'm not a huge fan of that but it is it
does support it so for readability for
business this is one approach you can
take
it's also cross-platform testing so you
can test across multiple browsers you
can test headless you can also push this
out to docker and run across a grid like
framework
it also has command line
and continuous integration pipelines
remote execution and a bunch of add-ons
which i'll briefly cover but i'm not
going to get into specifics to that
and proven testing solutions so it works
with web testing android testing ios
selenium and appy
the documentation
the key thing here i would recommend
if you're going to check this out
definitely start with creating an
account
go through installation and setup this
walks you through how to install the
agent
what you might need to do to set
security settings so that the agent will
actually run on your device
and some other things like you know
quick getting started and getting
started with ios testing
so we're actually going to jump in and
get our hands dirty right off the get-go
so we're not going to worry too much
about that but if you want to come back
later and check this out this is how you
can do it just go under documents
they also have some blogs these are
really cool they talk about selenium 4
some other things in the community
behavior driven development they've got
a lot of
interesting articles out here check some
of those out if you have time
they also have an online forum so you
can ask questions look and see what
issues people are having see if anything
relates to what you're doing
full online support really good
community
you can also search their site it's
really cool
and then you can also kind of look for
different things within the site
key shortcuts frequently asked questions
and so on
okay so from the test i o page we go up
to log in here
so it's going to log me in
now i've already installed the agent but
in order for the test to work or the
test recorder piece to work you have to
actually run the agent so right now it's
not running so let me kick that off
while i talk about the dashboard
so when you log into test project for
the very first time you're going to see
this little interface here
and we have things like project monitor
add-ons reports agents and integration
you also have this new test featured for
recording new tests and you also have
open file if you want to import tests
from your local file system
this little icon here indicates if you
have an agent running and you can have
multiple agents running if you wish so
you could have multiple workers if you
want to try to run multi-threaded
you can also invite people to
your project so you can build your
project team i have not seen a
limitation on this and again this is all
free so this is something maybe as a
group we might want to play around with
it also comes once you first log in for
the first time it comes with a pre-built
test case so the first thing they
recommend you do is once you log in just
run this guy see how it works so we'll
click run
oh okay so to run my test i have to pick
an agent
so since i only have the one agent right
now my first agent i can select that
i can do web testing or mobile testing
now we're not going to focus on mobile
today i'll cover that in the future
so when you select web it gives you all
the different browsers that are
currently installed
on your machine so what can the agent
work with
so i have chrome i have edge i have
firefox and i have safari
now just a little note safari
given the last
ios major update for mojave
this depending upon your security
settings may not work so you may have to
reduce your security settings of safari
in order to actually run safari tests
since most of the world is windows-based
or linux-based safari is just mac so
most of the other browsers here are
where you're going to focus your time
so we'll do chrome
and then i will hit next
so it says override default input
parameters or use source data i don't
have a data file yet so we'll override
the default inputs
and what this does is it looks at the
test and it says oh you have these three
input fields
what is the data that you want to enter
from them so we have the password 123
john doe
and
the start url for the test which is
going to be examples.testproject.io
web
then click run
and while it's running you can hit show
monitor and it will show you all your
agents that are running
so it's repair and it gives you the
status that's preparing the test now
since i ran it in the head mode it
actually opened up the browser it's
walking through it's populating the
values
and it just walked through and it
populated the test page
test finish we have a hundred percent
so as soon as it's done tearing down
this uh agent will shut down
so now it's gone
so now if i go back over to projects
so here's my project i can go here where
you see this little
graph icon
and i can click that and it takes us to
the reports for this run
so this test ran it took 27 seconds
we started it on november 13th the agent
we used was an apple agent my first
agent
so if you actually had multiple machines
with multiple agents you could run these
across like apple windows linux
if you had docker set up you could point
it to different dock
and on your doctor
if you install the agents on each of
your docker instances you can point to
those instances
it shows you the steps that ran
and the steps that passed so if anything
failed you would see a failure
and then you can look at the historical
runs of this so i ran this two days ago
seven days ago
and you can kind of look at the
different history of each
for instance i tried to run doctor who
earlier this morning and it failed
so if you look it says hey we had 100
passing on chrome but safari
it did not run the agent failed because
of the security settings
see test no longer exists so i can't
actually debug into the test but you
could walk into the tests
you can look at the summary report
which you can export and these are
really cool because you can look at the
summary report it's very clean
has all the information that you need
and then you can provide this summary to
the business or to
the developers or business managers
project managers basically say okay here
is the results of our test run
if you're trying to do some additional
debugging or you need to go into
you know further detail for development
they can look at the full report
which not only gives it the summary but
it also gives you the execution details
as well so here's the full details
here's all the steps that ran
here's the results
and the detail
so here we see safari did not run it
errored out the agent failed to kick it
off
one thing you have to be careful of is
make sure you do not close your test
project tab because then you have to
kind of relog in and start over just
quick overview of the menu here so we
have our test jobs these are all the
tests that we've recorded or we've
scripted
if you're working in an offline state
you can click the three dots here and
you can actually save your test as a
file
and if we were to
just save it without you can export it
as a package but we'll just save it as a
file
what's interesting about this is it will
save it as a yaml file
and if we look at the yaml file we see
that okay here's all that information
that we see at the top of our summary
report the project name who created it
when it was created but then you have
the different steps so
your first step here id my first test
then in here you have your settings
the application
again step
the action you want to take
the parameter mappings so it's kind of
like a
json file source except it's just a yaml
file and but it contains all the
information you can configure from this
file
including data that you can then save
and then run through their command line
interface or export this to jenkins
hudson or whatever and then run this
test offline
so it's kind of cool that we can do that
you