Efficient Data Flow Processing in an API Automation Testing Framework

1. Goal of Data Flow Processing

Data flow in an API automation framework includes data generation, parameterization, transmission, storage, and verification to ensure smooth and efficient test execution.

2. Data Generation

Python's built‑in libraries such as random and string can generate random strings and numbers. Example code:

import random
import string

def generate_random_string(length=10):
    """生成随机字符串"""
    letters = string.ascii_lowercase
    return ''.join(random.choice(letters) for _ in range(length))

def generate_random_number(length=10):
    """生成随机数字"""
    return ''.join(random.choice(string.digits) for _ in range(length))

random_string = generate_random_string(12)
random_number = generate_random_number(8)
print(f"随机字符串：{random_string}")
print(f"随机数字：{random_number}")

For more complex data, third‑party libraries like Faker can create realistic user information:

pip install faker

from faker import Faker
fake = Faker()
user_data = {
    "name": fake.name(),
    "email": fake.email(),
    "address": fake.address(),
    "phone_number": fake.phone_number()
}
print(user_data)

3. Parameterization

Pytest's @pytest.mark.parametrize enables test case parameterization:

import pytest
test_data = [
    ("John Doe", "[email protected]"),
    ("Jane Doe", "[email protected]")
]

@pytest.mark.parametrize("name, email", test_data)
def test_user_creation(name, email):
    assert len(name) > 0
    assert "@" in email

Test data can also be loaded from external JSON files:

import json

def load_test_data(file_path):
    with open(file_path, "r") as file:
        return json.load(file)

test_data = load_test_data("test_data.json")

@pytest.mark.parametrize("data", test_data)
def test_user_creation(data):
    assert len(data["name"]) > 0
    assert "@" in data["email"]

4. Data Transfer

Pytest fixtures share data between tests:

import pytest

@pytest.fixture
def user_data():
    return {"name": "John Doe", "email": "[email protected]"}

def test_user_name(user_data):
    assert user_data["name"] == "John Doe"

def test_user_email(user_data):
    assert user_data["email"] == "[email protected]"

Global variables can also be used cautiously:

user_data = {"name": "John Doe", "email": "[email protected]"}

def test_user_name():
    assert user_data["name"] == "John Doe"

def test_user_email():
    assert user_data["email"] == "[email protected]"

5. Data Storage

Test data can be saved to JSON files:

import json

def save_test_data(file_path, data):
    with open(file_path, "w") as file:
        json.dump(data, file, indent=4)

test_data = {"name": "John Doe", "email": "[email protected]"}
save_test_data("test_data.json", test_data)

Or persisted in a MySQL database:

import pymysql

def save_test_data_to_db(data):
    connection = pymysql.connect(
        host="localhost",
        user="root",
        password="password",
        db="testdb",
        charset="utf8mb4",
        cursorclass=pymysql.cursors.DictCursor
    )
    try:
        with connection.cursor() as cursor:
            sql = "INSERT INTO users (name, email) VALUES (%s, %s)"
            cursor.execute(sql, (data["name"], data["email"]))
        connection.commit()
    finally:
        connection.close()

test_data = {"name": "John Doe", "email": "[email protected]"}
save_test_data_to_db(test_data)

6. Data Validation

Validate API responses with assertions:

import requests

def test_user_info():
    response = requests.get("https://api.example.com/users/1")
    assert response.status_code == 200
    data = response.json()
    assert data["name"] == "John Doe"
    assert data["email"] == "[email protected]"

For complex JSON structures, use JSON Schema validation:

pip install jsonschema

import jsonschema
from jsonschema import validate

user_schema = {
    "type": "object",
    "properties": {
        "id": {"type": "integer"},
        "name": {"type": "string"},
        "email": {"type": "string"}
    },
    "required": ["id", "name", "email"]
}

def test_user_info():
    response = requests.get("https://api.example.com/users/1")
    assert response.status_code == 200
    data = response.json()
    validate(instance=data, schema=user_schema)

7. Conclusion

By thoughtfully designing data generation, parameterization, transfer, storage, and validation, developers can achieve an efficient, flexible, and maintainable data flow in API automation frameworks.