loops Scenario 1 — Iterate Over URL List Variable
Written by RTILA X Engineering Team
Beginner ~4 min
What You'll Learn
Iterate over a list of URLs
Real-World Use Case
Scraping multiple product pages
LIVE DEMO
EXPECTED OUTPUT
RTILA X PROJECT JSON
{
"name": "Iterate_URL_List",
"settings": {
"urls": [
"https://learn.rtila.com/scenarios/loops/1"
],
"headless": false,
"navigation_timeout": 30000,
"max_concurrent_workers": 1,
"humanoidEnabled": true,
"humanoidSensitivity": "medium",
"variables": [
{
"name": "url_list",
"is_list": true,
"value": [
"https://learn.rtila.com/scenarios/basic-navigation/1",
"https://learn.rtila.com/scenarios/basic-navigation/2",
"https://learn.rtila.com/scenarios/basic-navigation/3",
"https://learn.rtila.com/scenarios/basic-navigation/4",
"https://learn.rtila.com/scenarios/basic-navigation/5"
]
}
]
},
"datasets": {
"visited_pages": {
"item_selector": "css=title",
"properties": [
{
"name": "title",
"type": "text",
"selector": "css=title"
}
]
}
},
"commands": [
{
"command": "goto",
"params": {
"url": "https://learn.rtila.com/scenarios/loops/1"
}
},
{
"command": "for_each",
"params": {
"source_type": "variable",
"variable": "url_list",
"as": "url",
"do": [
{
"command": "goto",
"params": {
"url": "${url}"
}
},
{
"command": "wait_for_selector",
"params": {
"selector": "css=title"
}
},
{
"command": "extract_data",
"params": {
"dataset": "visited_pages"
}
}
]
}
}
]
}
RTILA X Concepts
This scenario demonstrates the for_each command using a list variable. Each URL is visited in turn and the page title is extracted into the dataset.
Did you complete this scenario?
Ready to run this automation?
Copy the project JSON above, open RTILA X, create a new project, and paste it.
This scenario covers 2 RTILA X commands and is referenced in 2 learning articles.
Continue Learning
Was this helpful?
Thank you for your feedback!