Skip to main content

loops Scenario 1 — Iterate Over URL List Variable

Written by RTILA X Engineering Team

Beginner ~4 min

What You'll Learn

Iterate over a list of URLs

Real-World Use Case

Scraping multiple product pages

LIVE DEMO

EXPECTED OUTPUT

RTILA X PROJECT JSON

    {
  "name": "Iterate_URL_List",
  "settings": {
    "urls": [
      "https://learn.rtila.com/scenarios/loops/1"
    ],
    "headless": false,
    "navigation_timeout": 30000,
    "max_concurrent_workers": 1,
    "humanoidEnabled": true,
    "humanoidSensitivity": "medium",
    "variables": [
      {
        "name": "url_list",
        "is_list": true,
        "value": [
          "https://learn.rtila.com/scenarios/basic-navigation/1",
          "https://learn.rtila.com/scenarios/basic-navigation/2",
          "https://learn.rtila.com/scenarios/basic-navigation/3",
          "https://learn.rtila.com/scenarios/basic-navigation/4",
          "https://learn.rtila.com/scenarios/basic-navigation/5"
        ]
      }
    ]
  },
  "datasets": {
    "visited_pages": {
      "item_selector": "css=title",
      "properties": [
        {
          "name": "title",
          "type": "text",
          "selector": "css=title"
        }
      ]
    }
  },
  "commands": [
    {
      "command": "goto",
      "params": {
        "url": "https://learn.rtila.com/scenarios/loops/1"
      }
    },
    {
      "command": "for_each",
      "params": {
        "source_type": "variable",
        "variable": "url_list",
        "as": "url",
        "do": [
          {
            "command": "goto",
            "params": {
              "url": "${url}"
            }
          },
          {
            "command": "wait_for_selector",
            "params": {
              "selector": "css=title"
            }
          },
          {
            "command": "extract_data",
            "params": {
              "dataset": "visited_pages"
            }
          }
        ]
      }
    }
  ]
}
  

RTILA X Concepts

This scenario demonstrates the for_each command using a list variable. Each URL is visited in turn and the page title is extracted into the dataset.

Did you complete this scenario?

Ready to run this automation?

Copy the project JSON above, open RTILA X, create a new project, and paste it.

This scenario covers 2 RTILA X commands and is referenced in 2 learning articles.

Continue Learning

Was this helpful?