[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "image", "x": 2125, "y": 2533}, {"label": "common", "x": 1141, "y": 2232}, {"label": "common", "x": 1141, "y": 2324}, {"label": "common", "x": 1141, "y": 2418}, {"label": "common", "x": 1140, "y": 2517}, {"label": "common", "x": 1140, "y": 2610}, {"label": "common", "x": 1141, "y": 2705}, {"label": "common", "x": 1140, "y": 2801}, {"label": "common", "x": 1186, "y": 2922}, {"label": "common", "x": 1394, "y": 2923}, {"label": "common", "x": 1599, "y": 2921}, {"label": "common", "x": 1805, "y": 2923}, {"label": "common", "x": 2011, "y": 2921}, {"label": "common", "x": 2217, "y": 2920}, {"label": "common", "x": 2424, "y": 2921}, {"label": "common", "x": 2630, "y": 2921}, {"label": "common", "x": 2840, "y": 2923}, {"label": "common", "x": 3046, "y": 2920}, {"label": "common", "x": 2900, "y": 2135}, {"label": "image", "x": 2762, "y": 2136}, {"label": "image", "x": 2581, "y": 2136}, {"label": "common", "x": 2657, "y": 2136}, {"label": "image", "x": 2277, "y": 2136}, {"label": "common", "x": 2413, "y": 2136}, {"label": "image", "x": 2003, "y": 2136}, {"label": "common", "x": 2126, "y": 2136}, {"label": "heading", "x": 1337, "y": 2073}, {"label": "image", "x": 1216, "y": 2135}, {"label": "common", "x": 1357, "y": 2136}, {"label": "image", "x": 1521, "y": 2135}, {"label": "common", "x": 1639, "y": 2136}, {"label": "image", "x": 1787, "y": 2135}, {"label": "common", "x": 1878, "y": 2135}, {"label": "heading", "x": 2218, "y": 3034}, {"label": "common", "x": 2159, "y": 3096}, {"label": "common", "x": 2160, "y": 3179}, {"label": "common", "x": 2163, "y": 3253}, {"label": "common", "x": 2161, "y": 3322}, {"label": "common", "x": 2162, "y": 3394}, {"label": "common", "x": 2159, "y": 3464}, {"label": "common", "x": 2159, "y": 3536}, {"label": "common", "x": 2163, "y": 3607}, {"label": "common", "x": 2163, "y": 3678}, {"label": "common", "x": 2165, "y": 3749}, {"label": "common", "x": 2164, "y": 3819}, {"label": "common", "x": 2165, "y": 3852}, {"label": "common", "x": 2639, "y": 3870}, {"label": "image", "x": 2653, "y": 3471}, {"label": "heading", "x": 159, "y": 3035}, {"label": "common", "x": 1060, "y": 3118}, {"label": "image", "x": 1059, "y": 3536}, {"label": "common", "x": 189, "y": 3196}, {"label": "common", "x": 209, "y": 3610}, {"label": "common", "x": 909, "y": 3611}, {"label": "common", "x": 953, "y": 3796}, {"label": "common", "x": 1354, "y": 3195}, {"label": "common", "x": 1705, "y": 3610}, {"label": "common", "x": 1781, "y": 3789}, {"label": "image", "x": 569, "y": 2578}, {"label": "common", "x": 101, "y": 2286}, {"label": "common", "x": 101, "y": 2385}, {"label": "common", "x": 101, "y": 2464}, {"label": "common", "x": 99, "y": 2547}, {"label": "common", "x": 101, "y": 2628}, {"label": "common", "x": 100, "y": 2708}, {"label": "common", "x": 101, "y": 2789}, {"label": "common", "x": 110, "y": 2870}, {"label": "common", "x": 139, "y": 2892}, {"label": "common", "x": 459, "y": 2918}, {"label": "common", "x": 776, "y": 2892}, {"label": "heading", "x": 246, "y": 2074}, {"label": "image", "x": 417, "y": 2135}, {"label": "image", "x": 417, "y": 2175}, {"label": "image", "x": 418, "y": 2215}, {"label": "image", "x": 417, "y": 2255}, {"label": "image", "x": 726, "y": 2136}, {"label": "image", "x": 726, "y": 2175}, {"label": "image", "x": 727, "y": 2217}, {"label": "common", "x": 536, "y": 2137}, {"label": "common", "x": 559, "y": 2176}, {"label": "common", "x": 556, "y": 2219}, {"label": "common", "x": 554, "y": 2257}, {"label": "common", "x": 801, "y": 2136}, {"label": "common", "x": 849, "y": 2176}, {"label": "common", "x": 818, "y": 2216}, {"label": "image", "x": 1963, "y": 1714}, {"label": "common", "x": 1771, "y": 1353}, {"label": "image", "x": 841, "y": 1759}, {"label": "common", "x": 116, "y": 1645}, {"label": "common", "x": 117, "y": 1753}, {"label": "common", "x": 123, "y": 1863}, {"label": "common", "x": 158, "y": 1932}, {"label": "common", "x": 470, "y": 1956}, {"label": "common", "x": 780, "y": 1932}, {"label": "common", "x": 1088, "y": 1956}, {"label": "common", "x": 1401, "y": 1932}, {"label": "heading", "x": 189, "y": 1353}, {"label": "image", "x": 234, "y": 1416}, {"label": "image", "x": 236, "y": 1456}, {"label": "image", "x": 235, "y": 1495}, {"label": "image", "x": 235, "y": 1535}, {"label": "image", "x": 235, "y": 1575}, {"label": "common", "x": 314, "y": 1416}, {"label": "common", "x": 303, "y": 1458}, {"label": "common", "x": 314, "y": 1498}, {"label": "common", "x": 357, "y": 1537}, {"label": "common", "x": 297, "y": 1575}, {"label": "image", "x": 507, "y": 1414}, {"label": "common", "x": 554, "y": 1417}, {"label": "image", "x": 508, "y": 1456}, {"label": "image", "x": 507, "y": 1496}, {"label": "image", "x": 508, "y": 1535}, {"label": "image", "x": 664, "y": 1415}, {"label": "image", "x": 664, "y": 1456}, {"label": "image", "x": 664, "y": 1497}, {"label": "image", "x": 664, "y": 1536}, {"label": "image", "x": 832, "y": 1417}, {"label": "image", "x": 832, "y": 1456}, {"label": "image", "x": 832, "y": 1496}, {"label": "image", "x": 832, "y": 1537}, {"label": "image", "x": 1083, "y": 1415}, {"label": "image", "x": 1082, "y": 1456}, {"label": "image", "x": 1082, "y": 1495}, {"label": "image", "x": 1082, "y": 1536}, {"label": "image", "x": 1318, "y": 1415}, {"label": "image", "x": 1318, "y": 1457}, {"label": "image", "x": 1318, "y": 1495}, {"label": "image", "x": 1318, "y": 1537}, {"label": "common", "x": 551, "y": 1456}, {"label": "common", "x": 562, "y": 1497}, {"label": "common", "x": 570, "y": 1535}, {"label": "common", "x": 711, "y": 1416}, {"label": "common", "x": 733, "y": 1456}, {"label": "common", "x": 729, "y": 1496}, {"label": "common", "x": 717, "y": 1537}, {"label": "common", "x": 940, "y": 1417}, {"label": "common", "x": 940, "y": 1458}, {"label": "common", "x": 886, "y": 1496}, {"label": "common", "x": 889, "y": 1536}, {"label": "common", "x": 1142, "y": 1417}, {"label": "common", "x": 1121, "y": 1455}, {"label": "common", "x": 1145, "y": 1497}, {"label": "common", "x": 1186, "y": 1538}, {"label": "common", "x": 1372, "y": 1416}, {"label": "common", "x": 1367, "y": 1456}, {"label": "common", "x": 1391, "y": 1497}, {"label": "common", "x": 1405, "y": 1537}, {"label": "heading", "x": 670, "y": 392}, {"label": "image", "x": 1457, "y": 847}, {"label": "heading", "x": 369, "y": 239}, {"label": "button", "x": 703, "y": 241}, {"label": "heading", "x": 194, "y": 394}, {"label": "text-input", "x": 105, "y": 511}, {"label": "text-input", "x": 342, "y": 509}, {"label": "common", "x": 119, "y": 565}, {"label": "text-input", "x": 298, "y": 614}, {"label": "button", "x": 486, "y": 613}, {"label": "common", "x": 170, "y": 675}, {"label": "text-input", "x": 297, "y": 724}, {"label": "button", "x": 481, "y": 723}, {"label": "heading", "x": 239, "y": 874}, {"label": "common", "x": 287, "y": 1079}, {"label": "button", "x": 2796, "y": 258}, {"label": "button", "x": 3032, "y": 256}, {"label": "heading", "x": 2611, "y": 393}, {"label": "table-cell", "x": 2593, "y": 455}, {"label": "button", "x": 2765, "y": 456}, {"label": "table-cell", "x": 2939, "y": 454}, {"label": "button", "x": 3066, "y": 454}, {"label": "table-cell", "x": 2594, "y": 500}, {"label": "table-cell", "x": 2940, "y": 500}, {"label": "table-cell", "x": 2595, "y": 543}, {"label": "table-cell", "x": 2941, "y": 544}, {"label": "table-cell", "x": 2594, "y": 587}, {"label": "table-cell", "x": 2941, "y": 586}, {"label": "table-cell", "x": 2594, "y": 630}, {"label": "table-cell", "x": 2940, "y": 628}, {"label": "table-cell", "x": 2594, "y": 670}, {"label": "table-cell", "x": 2940, "y": 670}, {"label": "table-cell", "x": 2594, "y": 712}, {"label": "table-cell", "x": 2939, "y": 712}, {"label": "table-cell", "x": 2595, "y": 754}, {"label": "table-cell", "x": 2939, "y": 754}, {"label": "table-cell", "x": 2594, "y": 796}, {"label": "table-cell", "x": 2940, "y": 795}, {"label": "table-cell", "x": 2595, "y": 837}, {"label": "table-cell", "x": 2939, "y": 837}, {"label": "table-cell", "x": 2594, "y": 880}, {"label": "table-cell", "x": 2939, "y": 878}, {"label": "table-cell", "x": 2594, "y": 922}, {"label": "table-cell", "x": 2939, "y": 921}, {"label": "table-cell", "x": 2594, "y": 963}, {"label": "table-cell", "x": 2938, "y": 963}, {"label": "table-cell", "x": 2594, "y": 1006}, {"label": "table-cell", "x": 2939, "y": 1005}, {"label": "table-cell", "x": 2594, "y": 1047}, {"label": "table-cell", "x": 2939, "y": 1047}, {"label": "table-cell", "x": 2594, "y": 1089}, {"label": "table-cell", "x": 2939, "y": 1089}, {"label": "table-cell", "x": 2594, "y": 1132}, {"label": "table-cell", "x": 2939, "y": 1131}, {"label": "table-cell", "x": 2594, "y": 1173}, {"label": "table-cell", "x": 2939, "y": 1173}, {"label": "table-cell", "x": 2594, "y": 1216}, {"label": "table-cell", "x": 2937, "y": 1216}, {"label": "table-cell", "x": 2594, "y": 1259}, {"label": "table-cell", "x": 2938, "y": 1259}, {"label": "table-cell", "x": 2595, "y": 1301}, {"label": "table-cell", "x": 2939, "y": 1300}, {"label": "table-cell", "x": 2596, "y": 1343}, {"label": "table-cell", "x": 2939, "y": 1341}, {"label": "table-cell", "x": 2596, "y": 1385}, {"label": "table-cell", "x": 2940, "y": 1384}, {"label": "table-cell", "x": 2594, "y": 1426}, {"label": "table-cell", "x": 2940, "y": 1425}, {"label": "table-cell", "x": 2596, "y": 1467}, {"label": "table-cell", "x": 2941, "y": 1467}, {"label": "table-cell", "x": 2595, "y": 1510}, {"label": "table-cell", "x": 2941, "y": 1510}, {"label": "table-cell", "x": 2595, "y": 1552}, {"label": "table-cell", "x": 2940, "y": 1551}, {"label": "table-cell", "x": 2596, "y": 1595}, {"label": "table-cell", "x": 2940, "y": 1594}, {"label": "table-cell", "x": 2593, "y": 1636}, {"label": "table-cell", "x": 2940, "y": 1637}, {"label": "table-cell", "x": 2593, "y": 1678}, {"label": "table-cell", "x": 2939, "y": 1678}, {"label": "table-cell", "x": 2594, "y": 1721}, {"label": "table-cell", "x": 2939, "y": 1720}, {"label": "table-cell", "x": 2594, "y": 1762}, {"label": "table-cell", "x": 2940, "y": 1763}, {"label": "table-cell", "x": 2596, "y": 1805}, {"label": "table-cell", "x": 2940, "y": 1804}, {"label": "table-cell", "x": 2593, "y": 1847}, {"label": "table-cell", "x": 2941, "y": 1846}, {"label": "table-cell", "x": 2594, "y": 1889}, {"label": "table-cell", "x": 2940, "y": 1887}, {"label": "table-cell", "x": 2593, "y": 1930}, {"label": "table-cell", "x": 2940, "y": 1930}, {"label": "table-cell", "x": 2593, "y": 1972}, {"label": "table-cell", "x": 2940, "y": 1972}, {"label": "table-row", "x": 2745, "y": 1972}, {"label": "table-row", "x": 2745, "y": 1931}, {"label": "table-row", "x": 2745, "y": 1890}, {"label": "table-row", "x": 2746, "y": 1847}, {"label": "table-row", "x": 2747, "y": 1803}, {"label": "table-row", "x": 2745, "y": 1762}, {"label": "table-row", "x": 2745, "y": 1720}, {"label": "table-row", "x": 2745, "y": 1678}, {"label": "table-row", "x": 2745, "y": 1637}, {"label": "table-row", "x": 2746, "y": 1595}, {"label": "table-row", "x": 2745, "y": 1551}, {"label": "table-row", "x": 2745, "y": 1510}, {"label": "table-row", "x": 2747, "y": 1467}, {"label": "table-row", "x": 2745, "y": 1425}, {"label": "table-row", "x": 2745, "y": 1384}, {"label": "table-row", "x": 2745, "y": 1342}, {"label": "table-row", "x": 2745, "y": 1300}, {"label": "table-row", "x": 2744, "y": 1257}, {"label": "table-row", "x": 2744, "y": 1216}, {"label": "table-row", "x": 2745, "y": 1173}, {"label": "table-row", "x": 2745, "y": 1132}, {"label": "table-row", "x": 2745, "y": 1089}, {"label": "table-row", "x": 2745, "y": 1047}, {"label": "table-row", "x": 2745, "y": 1005}, {"label": "table-row", "x": 2745, "y": 964}, {"label": "table-row", "x": 2745, "y": 922}, {"label": "table-row", "x": 2745, "y": 879}, {"label": "table-row", "x": 2745, "y": 837}, {"label": "table-row", "x": 2745, "y": 796}, {"label": "table-row", "x": 2745, "y": 753}, {"label": "table-row", "x": 2745, "y": 712}, {"label": "table-row", "x": 2745, "y": 670}, {"label": "table-row", "x": 2745, "y": 628}, {"label": "table-row", "x": 2745, "y": 587}, {"label": "table-row", "x": 2747, "y": 543}, {"label": "table-row", "x": 2746, "y": 500}, {"label": "table-row", "x": 2747, "y": 455}, {"label": "table", "x": 2748, "y": 1212}, {"label": "button", "x": 154, "y": 57}, {"label": "button", "x": 401, "y": 63}, {"label": "button", "x": 630, "y": 64}, {"label": "button", "x": 855, "y": 63}, {"label": "button", "x": 1079, "y": 62}, {"label": "button", "x": 949, "y": 66}, {"label": "button", "x": 724, "y": 66}, {"label": "button", "x": 497, "y": 66}, {"label": "button", "x": 1308, "y": 62}, {"label": "button", "x": 1543, "y": 62}, {"label": "button", "x": 1642, "y": 65}, {"label": "button", "x": 3106, "y": 61}, {"label": "button", "x": 3006, "y": 62}, {"label": "button", "x": 2907, "y": 61}, {"label": "button", "x": 2797, "y": 61}, {"label": "button", "x": 2840, "y": 64}, {"label": "button", "x": 2682, "y": 61}, {"label": "button", "x": 2726, "y": 65}, {"label": "text-input", "x": 4755, "y": 2165}, {"label": "button", "x": 3241, "y": 116}, {"label": "button", "x": 3356, "y": 64}, {"label": "button", "x": 3425, "y": 62}, {"label": "button", "x": 3469, "y": 69}, {"label": "button", "x": 3524, "y": 64}, {"label": "button", "x": 3614, "y": 62}, {"label": "heading", "x": 4760, "y": 67}, {"label": "button", "x": 6057, "y": 49}, {"label": "button", "x": 6143, "y": 49}, {"label": "button", "x": 6258, "y": 49}, {"label": "button", "x": 6306, "y": 190}, {"label": "button", "x": 4727, "y": 203}, {"label": "button", "x": 4548, "y": 201}, {"label": "button", "x": 4331, "y": 201}, {"label": "button", "x": 4086, "y": 201}, {"label": "button", "x": 3817, "y": 201}, {"label": "button", "x": 3582, "y": 201}, {"label": "button", "x": 3404, "y": 201}, {"label": "button", "x": 3215, "y": 324}, {"label": "button", "x": 3811, "y": 291}, {"label": "button", "x": 3811, "y": 334}, {"label": "button", "x": 3809, "y": 370}, {"label": "button", "x": 5716, "y": 334}, {"label": "button", "x": 6312, "y": 334}, {"label": "button", "x": 6312, "y": 419}, {"label": "button", "x": 6315, "y": 3081}, {"label": "button", "x": 6315, "y": 3328}, {"label": "button", "x": 6312, "y": 3413}, {"label": "button", "x": 6312, "y": 3495}, {"label": "button", "x": 6312, "y": 3587}, {"label": "button", "x": 5934, "y": 3685}, {"label": "button", "x": 6114, "y": 3680}, {"label": "button", "x": 6298, "y": 3688}, {"label": "common", "x": 5840, "y": 3688}, {"label": "button", "x": 5517, "y": 3685}, {"label": "button", "x": 5572, "y": 3685}, {"label": "button", "x": 5628, "y": 3685}, {"label": "button", "x": 5684, "y": 3685}, {"label": "button", "x": 5743, "y": 3685}, {"label": "button", "x": 5699, "y": 3834}, {"label": "button", "x": 5786, "y": 3850}, {"label": "button", "x": 5863, "y": 3847}, {"label": "button", "x": 5941, "y": 3847}, {"label": "button", "x": 6012, "y": 3847}, {"label": "button", "x": 6174, "y": 3850}, {"label": "button", "x": 6317, "y": 3847}, {"label": "common", "x": 3884, "y": 3688}, {"label": "common", "x": 3562, "y": 3683}, {"label": "common", "x": 3306, "y": 3688}, {"label": "button", "x": 3252, "y": 3847}, {"label": "button", "x": 3497, "y": 3847}, {"label": "button", "x": 3689, "y": 3847}, {"label": "button", "x": 3880, "y": 3847}, {"label": "button", "x": 4072, "y": 3847}, {"label": "image", "x": 2743, "y": 6087}, {"label": "button", "x": 47, "y": 4058}, {"label": "button", "x": 146, "y": 4055}, {"label": "button", "x": 472, "y": 4055}, {"label": "button", "x": 793, "y": 4055}, {"label": "button", "x": 900, "y": 4050}, {"label": "button", "x": 1003, "y": 4053}, {"label": "button", "x": 1257, "y": 4053}, {"label": "button", "x": 1476, "y": 4007}, {"label": "button", "x": 1477, "y": 4098}, {"label": "button", "x": 1741, "y": 4047}, {"label": "button", "x": 1958, "y": 4004}, {"label": "button", "x": 1958, "y": 4090}, {"label": "button", "x": 2098, "y": 4053}, {"label": "button", "x": 2157, "y": 4053}, {"label": "button", "x": 2231, "y": 4053}, {"label": "button", "x": 2294, "y": 4055}, {"label": "button", "x": 105, "y": 4274}, {"label": "button", "x": 290, "y": 4271}, {"label": "button", "x": 509, "y": 4276}, {"label": "common", "x": 885, "y": 4276}, {"label": "button", "x": 111, "y": 7479}, {"label": "common", "x": 292, "y": 7479}, {"label": "button", "x": 534, "y": 7484}, {"label": "common", "x": 866, "y": 7482}, {"label": "button", "x": 1254, "y": 7479}, {"label": "common", "x": 1461, "y": 7479}, {"label": "button", "x": 1952, "y": 7474}, {"label": "common", "x": 2110, "y": 7482}, {"label": "button", "x": 551, "y": 7182}, {"label": "common", "x": 620, "y": 7188}, {"label": "common", "x": 776, "y": 7193}, {"label": "button", "x": 1530, "y": 7180}, {"label": "button", "x": 2209, "y": 7158}, {"label": "button", "x": 2209, "y": 7217}, {"label": "button", "x": 2122, "y": 7698}, {"label": "common", "x": 989, "y": 7703}, {"label": "text-input", "x": 1506, "y": 7698}, {"label": "button", "x": 276, "y": 7703}, {"label": "button", "x": 615, "y": 7700}, {"label": "button", "x": 2438, "y": 7770}, {"label": "button", "x": 2639, "y": 7770}, {"label": "button", "x": 2843, "y": 7770}, {"label": "button", "x": 3045, "y": 7770}, {"label": "button", "x": 591, "y": 4665}, {"label": "button", "x": 754, "y": 4665}, {"label": "button", "x": 923, "y": 4668}, {"label": "image", "x": 720, "y": 5110}, {"label": "common", "x": 647, "y": 5491}, {"label": "button", "x": 720, "y": 5631}, {"label": "common", "x": 614, "y": 5777}, {"label": "button", "x": 719, "y": 5920}, {"label": "button", "x": 579, "y": 6076}, {"label": "common", "x": 690, "y": 6076}, {"label": "common", "x": 1034, "y": 4881}, {"label": "common", "x": 1066, "y": 5018}, {"label": "heading", "x": 962, "y": 5202}, {"label": "common", "x": 1031, "y": 5369}, {"label": "common", "x": 1051, "y": 5515}, {"label": "button", "x": 1595, "y": 5364}, {"label": "button", "x": 2075, "y": 5334}, {"label": "button", "x": 2078, "y": 5402}, {"label": "button", "x": 2127, "y": 5439}, {"label": "button", "x": 1598, "y": 5509}, {"label": "button", "x": 2078, "y": 5485}, {"label": "button", "x": 2079, "y": 5545}, {"label": "button", "x": 1648, "y": 4870}, {"label": "button", "x": 2178, "y": 4840}, {"label": "button", "x": 2178, "y": 4900}, {"label": "button", "x": 1646, "y": 5013}, {"label": "button", "x": 2181, "y": 4986}, {"label": "button", "x": 2180, "y": 5035}, {"label": "common", "x": 1063, "y": 5774}, {"label": "common", "x": 1057, "y": 5925}, {"label": "common", "x": 1006, "y": 6071}, {"label": "common", "x": 1048, "y": 6216}, {"label": "common", "x": 1047, "y": 6359}, {"label": "button", "x": 1648, "y": 5774}, {"label": "button", "x": 2178, "y": 5747}, {"label": "button", "x": 2181, "y": 5806}, {"label": "button", "x": 1620, "y": 5512}, {"label": "button", "x": 1649, "y": 5917}, {"label": "button", "x": 2180, "y": 5893}, {"label": "button", "x": 2183, "y": 5944}, {"label": "button", "x": 1646, "y": 6060}, {"label": "button", "x": 2181, "y": 6036}, {"label": "button", "x": 2183, "y": 6090}, {"label": "button", "x": 1648, "y": 6211}, {"label": "button", "x": 2180, "y": 6181}, {"label": "button", "x": 2183, "y": 6235}, {"label": "button", "x": 1155, "y": 6351}, {"label": "common", "x": 1226, "y": 6354}, {"label": "button", "x": 1729, "y": 6354}, {"label": "button", "x": 2178, "y": 6330}, {"label": "button", "x": 2180, "y": 6381}, {"label": "button", "x": 157, "y": 4646}, {"label": "common", "x": 319, "y": 4652}, {"label": "button", "x": 321, "y": 4727}, {"label": "button", "x": 322, "y": 4808}, {"label": "button", "x": 324, "y": 4894}, {"label": "button", "x": 322, "y": 4975}, {"label": "button", "x": 321, "y": 5054}, {"label": "button", "x": 322, "y": 5132}, {"label": "button", "x": 322, "y": 5210}, {"label": "button", "x": 322, "y": 5288}, {"label": "button", "x": 319, "y": 5375}, {"label": "button", "x": 319, "y": 5453}, {"label": "button", "x": 321, "y": 5531}, {"label": "button", "x": 321, "y": 5615}, {"label": "button", "x": 156, "y": 5696}, {"label": "common", "x": 325, "y": 5701}, {"label": "button", "x": 321, "y": 5779}, {"label": "button", "x": 321, "y": 5860}, {"label": "button", "x": 319, "y": 5941}, {"label": "button", "x": 319, "y": 6019}, {"label": "button", "x": 319, "y": 6100}, {"label": "button", "x": 319, "y": 6179}, {"label": "button", "x": 319, "y": 6257}, {"label": "button", "x": 319, "y": 6338}, {"label": "button", "x": 319, "y": 6421}, {"label": "button", "x": 155, "y": 6505}, {"label": "common", "x": 322, "y": 6513}, {"label": "button", "x": 321, "y": 6589}, {"label": "button", "x": 321, "y": 6667}, {"label": "image", "x": 165, "y": 5054}, {"label": "image", "x": 166, "y": 6675}, {"label": "button", "x": 3281, "y": 4081}, {"label": "button", "x": 3501, "y": 4085}, {"label": "button", "x": 3723, "y": 4085}, {"label": "button", "x": 3904, "y": 4091}, {"label": "button", "x": 4080, "y": 4081}, {"label": "button", "x": 4260, "y": 4085}, {"label": "button", "x": 4458, "y": 4085}, {"label": "text-input", "x": 5653, "y": 4085}, {"label": "button", "x": 5816, "y": 4091}, {"label": "button", "x": 5914, "y": 4088}, {"label": "button", "x": 6012, "y": 4085}, {"label": "button", "x": 6127, "y": 4085}, {"label": "button", "x": 6249, "y": 4085}, {"label": "heading", "x": 3523, "y": 4606}, {"label": "common", "x": 3454, "y": 4875}, {"label": "button", "x": 3723, "y": 4882}, {"label": "button", "x": 5756, "y": 4458}, {"label": "button", "x": 6010, "y": 4458}, {"label": "button", "x": 6248, "y": 4465}, {"label": "button", "x": 4031, "y": 4875}, {"label": "heading", "x": 3419, "y": 5218}, {"label": "heading", "x": 4287, "y": 5215}, {"label": "heading", "x": 4913, "y": 5215}, {"label": "common", "x": 5093, "y": 5218}, {"label": "heading", "x": 5601, "y": 5212}, {"label": "button", "x": 6159, "y": 5208}, {"label": "button", "x": 3519, "y": 5511}, {"label": "common", "x": 3616, "y": 5646}, {"label": "image", "x": 3994, "y": 5572}, {"label": "image", "x": 3397, "y": 5518}, {"label": "image", "x": 3397, "y": 5659}, {"label": "image", "x": 4131, "y": 5518}, {"label": "image", "x": 4130, "y": 5656}, {"label": "common", "x": 4385, "y": 5700}, {"label": "button", "x": 4248, "y": 5521}, {"label": "image", "x": 4863, "y": 5518}, {"label": "image", "x": 4863, "y": 5656}, {"label": "image", "x": 5460, "y": 5572}, {"label": "image", "x": 5597, "y": 5518}, {"label": "image", "x": 5597, "y": 5663}, {"label": "image", "x": 5599, "y": 6137}, {"label": "image", "x": 5596, "y": 6275}, {"label": "image", "x": 6194, "y": 5572}, {"label": "image", "x": 6194, "y": 6191}, {"label": "image", "x": 5599, "y": 6756}, {"label": "image", "x": 5597, "y": 6897}, {"label": "image", "x": 6195, "y": 6807}, {"label": "image", "x": 5597, "y": 7375}, {"label": "image", "x": 5597, "y": 7520}, {"label": "image", "x": 6194, "y": 7429}, {"label": "button", "x": 4981, "y": 5515}, {"label": "button", "x": 5716, "y": 5515}, {"label": "button", "x": 5715, "y": 6140}, {"label": "button", "x": 5716, "y": 6756}, {"label": "button", "x": 5715, "y": 7372}, {"label": "common", "x": 5852, "y": 5696}, {"label": "common", "x": 5797, "y": 6261}, {"label": "common", "x": 5787, "y": 6891}, {"label": "common", "x": 5131, "y": 5693}, {"label": "common", "x": 5850, "y": 7550}, {"label": "button", "x": 6321, "y": 5097}, {"label": "button", "x": 6321, "y": 6406}, {"label": "image", "x": 3231, "y": 4445}, {"label": "button", "x": 3235, "y": 4754}, {"label": "button", "x": 3236, "y": 5144}, {"label": "button", "x": 3236, "y": 5377}, {"label": "button", "x": 3234, "y": 5632}, {"label": "button", "x": 3236, "y": 5871}, {"label": "button", "x": 3235, "y": 6113}, {"label": "button", "x": 3236, "y": 6356}, {"label": "button", "x": 3235, "y": 6601}, {"label": "button", "x": 3236, "y": 7829}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "heading", "x": 212, "y": 963}, {"label": "button", "x": 788, "y": 965}, {"label": "button", "x": 934, "y": 965}, {"label": "heading", "x": 114, "y": 852}, {"label": "button", "x": 69, "y": 229}, {"label": "common", "x": 156, "y": 556}, {"label": "common", "x": 199, "y": 455}, {"label": "common", "x": 135, "y": 357}, {"label": "text-input", "x": 643, "y": 562}, {"label": "button", "x": 935, "y": 562}, {"label": "text-input", "x": 645, "y": 459}, {"label": "text-input", "x": 645, "y": 357}, {"label": "button", "x": 937, "y": 459}, {"label": "button", "x": 937, "y": 357}, {"label": "button", "x": 446, "y": 97}, {"label": "button", "x": 817, "y": 98}, {"label": "table-cell", "x": 695, "y": 561}, {"label": "table-cell", "x": 206, "y": 561}, {"label": "table-cell", "x": 695, "y": 459}, {"label": "table-cell", "x": 206, "y": 459}, {"label": "table-cell", "x": 696, "y": 355}, {"label": "table-cell", "x": 206, "y": 354}, {"label": "table-row", "x": 509, "y": 560}, {"label": "table-row", "x": 510, "y": 458}, {"label": "table-row", "x": 512, "y": 354}, {"label": "table", "x": 510, "y": 455}, {"label": "button", "x": 105, "y": 759}, {"label": "button", "x": 105, "y": 677}, {"label": "common", "x": 400, "y": 757}, {"label": "common", "x": 440, "y": 672}, {"label": "common", "x": 343, "y": 229}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "button", "x": 20, "y": 12}, {"label": "button", "x": 43, "y": 12}, {"label": "heading", "x": 606, "y": 12}, {"label": "button", "x": 1144, "y": 12}, {"label": "button", "x": 1168, "y": 12}, {"label": "button", "x": 1192, "y": 12}, {"label": "button", "x": 1189, "y": 41}, {"label": "button", "x": 1155, "y": 41}, {"label": "button", "x": 1185, "y": 76}, {"label": "button", "x": 1196, "y": 116}, {"label": "button", "x": 115, "y": 41}, {"label": "button", "x": 339, "y": 41}, {"label": "button", "x": 426, "y": 43}, {"label": "button", "x": 62, "y": 77}, {"label": "button", "x": 152, "y": 77}, {"label": "button", "x": 220, "y": 77}, {"label": "button", "x": 280, "y": 77}, {"label": "button", "x": 348, "y": 77}, {"label": "common", "x": 54, "y": 122}, {"label": "common", "x": 123, "y": 122}, {"label": "button", "x": 159, "y": 121}, {"label": "button", "x": 181, "y": 121}, {"label": "button", "x": 203, "y": 122}, {"label": "table-cell", "x": 23, "y": 147}, {"label": "table-cell", "x": 47, "y": 147}, {"label": "table-cell", "x": 47, "y": 189}, {"label": "table-cell", "x": 47, "y": 168}, {"label": "table-cell", "x": 23, "y": 168}, {"label": "table-cell", "x": 23, "y": 189}, {"label": "table-cell", "x": 73, "y": 147}, {"label": "table-cell", "x": 99, "y": 147}, {"label": "table-cell", "x": 125, "y": 147}, {"label": "table-cell", "x": 150, "y": 147}, {"label": "table-cell", "x": 174, "y": 147}, {"label": "table-cell", "x": 200, "y": 147}, {"label": "table-cell", "x": 73, "y": 168}, {"label": "table-cell", "x": 99, "y": 168}, {"label": "table-cell", "x": 125, "y": 168}, {"label": "table-cell", "x": 150, "y": 168}, {"label": "table-cell", "x": 174, "y": 168}, {"label": "table-cell", "x": 200, "y": 168}, {"label": "table-cell", "x": 73, "y": 189}, {"label": "table-cell", "x": 99, "y": 189}, {"label": "table-cell", "x": 125, "y": 189}, {"label": "table-cell", "x": 150, "y": 189}, {"label": "table-cell", "x": 174, "y": 189}, {"label": "table-cell", "x": 200, "y": 189}, {"label": "table-cell", "x": 23, "y": 209}, {"label": "table-cell", "x": 47, "y": 209}, {"label": "table-cell", "x": 73, "y": 209}, {"label": "table-cell", "x": 99, "y": 209}, {"label": "table-cell", "x": 125, "y": 209}, {"label": "table-cell", "x": 150, "y": 209}, {"label": "table-cell", "x": 174, "y": 209}, {"label": "table-cell", "x": 200, "y": 209}, {"label": "table-cell", "x": 23, "y": 230}, {"label": "table-cell", "x": 200, "y": 230}, {"label": "table-cell", "x": 174, "y": 230}, {"label": "table-cell", "x": 150, "y": 230}, {"label": "table-cell", "x": 125, "y": 230}, {"label": "table-cell", "x": 99, "y": 230}, {"label": "table-cell", "x": 73, "y": 230}, {"label": "table-cell", "x": 47, "y": 230}, {"label": "table-cell", "x": 23, "y": 252}, {"label": "table-cell", "x": 47, "y": 252}, {"label": "table-cell", "x": 73, "y": 252}, {"label": "table-cell", "x": 99, "y": 252}, {"label": "table-cell", "x": 125, "y": 252}, {"label": "table-cell", "x": 150, "y": 252}, {"label": "table-cell", "x": 174, "y": 252}, {"label": "table-cell", "x": 200, "y": 252}, {"label": "table-cell", "x": 23, "y": 273}, {"label": "table-cell", "x": 47, "y": 273}, {"label": "table-cell", "x": 73, "y": 273}, {"label": "table-cell", "x": 99, "y": 273}, {"label": "table-cell", "x": 125, "y": 273}, {"label": "table-cell", "x": 150, "y": 273}, {"label": "table-cell", "x": 174, "y": 273}, {"label": "table-cell", "x": 200, "y": 273}, {"label": "table-row", "x": 112, "y": 147}, {"label": "table-row", "x": 112, "y": 168}, {"label": "table-row", "x": 112, "y": 189}, {"label": "table-row", "x": 112, "y": 209}, {"label": "table-row", "x": 112, "y": 230}, {"label": "table-row", "x": 112, "y": 252}, {"label": "table-row", "x": 112, "y": 273}, {"label": "table", "x": 112, "y": 211}, {"label": "button", "x": 14, "y": 321}, {"label": "heading", "x": 55, "y": 320}, {"label": "button", "x": 32, "y": 342}, {"label": "button", "x": 49, "y": 342}, {"label": "common", "x": 99, "y": 345}, {"label": "button", "x": 32, "y": 360}, {"label": "button", "x": 49, "y": 360}, {"label": "common", "x": 122, "y": 363}, {"label": "common", "x": 584, "y": 446}, {"label": "table-cell", "x": 567, "y": 369}, {"label": "table-cell", "x": 742, "y": 370}, {"label": "table-cell", "x": 568, "y": 388}, {"label": "table-cell", "x": 742, "y": 388}, {"label": "table-cell", "x": 568, "y": 407}, {"label": "table-cell", "x": 742, "y": 407}, {"label": "table-row", "x": 685, "y": 370}, {"label": "table-row", "x": 685, "y": 388}, {"label": "table-row", "x": 685, "y": 408}, {"label": "table", "x": 685, "y": 388}, {"label": "button", "x": 446, "y": 115}, {"label": "common", "x": 295, "y": 117}, {"label": "common", "x": 493, "y": 116}, {"label": "text-input", "x": 852, "y": 116}, {"label": "image", "x": 1171, "y": 116}, {"label": "button", "x": 1191, "y": 151}, {"label": "common", "x": 240, "y": 151}, {"label": "common", "x": 475, "y": 151}, {"label": "common", "x": 705, "y": 151}, {"label": "common", "x": 952, "y": 151}, {"label": "button", "x": 238, "y": 245}, {"label": "common", "x": 279, "y": 245}, {"label": "button", "x": 320, "y": 245}, {"label": "common", "x": 406, "y": 244}, {"label": "common", "x": 935, "y": 245}, {"label": "button", "x": 1001, "y": 247}, {"label": "button", "x": 1042, "y": 247}, {"label": "button", "x": 1107, "y": 247}, {"label": "button", "x": 1175, "y": 247}, {"label": "table-cell", "x": 291, "y": 276}, {"label": "table-cell", "x": 432, "y": 277}, {"label": "table-cell", "x": 572, "y": 276}, {"label": "table-cell", "x": 712, "y": 277}, {"label": "table-cell", "x": 853, "y": 277}, {"label": "table-cell", "x": 994, "y": 277}, {"label": "table-cell", "x": 292, "y": 339}, {"label": "table-cell", "x": 292, "y": 439}, {"label": "table-cell", "x": 292, "y": 538}, {"label": "table-cell", "x": 292, "y": 638}, {"label": "table-cell", "x": 431, "y": 339}, {"label": "table-cell", "x": 432, "y": 439}, {"label": "table-cell", "x": 432, "y": 538}, {"label": "table-cell", "x": 432, "y": 638}, {"label": "table-cell", "x": 572, "y": 638}, {"label": "table-cell", "x": 572, "y": 538}, {"label": "table-cell", "x": 712, "y": 638}, {"label": "table-cell", "x": 712, "y": 538}, {"label": "table-cell", "x": 852, "y": 538}, {"label": "table-cell", "x": 852, "y": 638}, {"label": "table-cell", "x": 992, "y": 538}, {"label": "table-cell", "x": 993, "y": 638}, {"label": "table-cell", "x": 571, "y": 438}, {"label": "table-cell", "x": 712, "y": 438}, {"label": "table-cell", "x": 852, "y": 438}, {"label": "table-cell", "x": 992, "y": 438}, {"label": "table-cell", "x": 852, "y": 339}, {"label": "table-cell", "x": 992, "y": 339}, {"label": "table-cell", "x": 572, "y": 339}, {"label": "table-cell", "x": 712, "y": 339}, {"label": "table-cell", "x": 1133, "y": 339}, {"label": "table-cell", "x": 1133, "y": 438}, {"label": "table-cell", "x": 1133, "y": 538}, {"label": "table-cell", "x": 1133, "y": 638}, {"label": "image", "x": 1078, "y": 704}, {"label": "common", "x": 1127, "y": 705}, {"label": "button", "x": 1176, "y": 704}, {"label": "button", "x": 1199, "y": 708}, {"label": "table-cell", "x": 1133, "y": 277}, {"label": "table-row", "x": 712, "y": 276}, {"label": "table-row", "x": 712, "y": 338}, {"label": "table-row", "x": 712, "y": 438}, {"label": "table-row", "x": 712, "y": 538}, {"label": "table-row", "x": 713, "y": 638}, {"label": "table", "x": 713, "y": 476}, {"label": "common", "x": 231, "y": 299}, {"label": "common", "x": 345, "y": 299}, {"label": "common", "x": 496, "y": 299}, {"label": "common", "x": 636, "y": 299}, {"label": "common", "x": 776, "y": 299}, {"label": "common", "x": 917, "y": 299}, {"label": "button", "x": 433, "y": 321}, {"label": "button", "x": 573, "y": 322}, {"label": "button", "x": 713, "y": 322}, {"label": "button", "x": 713, "y": 346}, {"label": "button", "x": 853, "y": 323}, {"label": "common", "x": 1056, "y": 300}, {"label": "common", "x": 1193, "y": 300}, {"label": "common", "x": 232, "y": 401}, {"label": "common", "x": 354, "y": 400}, {"label": "common", "x": 494, "y": 401}, {"label": "common", "x": 914, "y": 400}, {"label": "common", "x": 1055, "y": 400}, {"label": "common", "x": 1195, "y": 400}, {"label": "common", "x": 232, "y": 499}, {"label": "common", "x": 354, "y": 499}, {"label": "common", "x": 493, "y": 499}, {"label": "common", "x": 633, "y": 498}, {"label": "common", "x": 772, "y": 499}, {"label": "common", "x": 914, "y": 499}, {"label": "common", "x": 1053, "y": 499}, {"label": "common", "x": 1193, "y": 499}, {"label": "common", "x": 231, "y": 598}, {"label": "common", "x": 353, "y": 598}, {"label": "common", "x": 493, "y": 598}, {"label": "common", "x": 632, "y": 598}, {"label": "common", "x": 772, "y": 598}, {"label": "common", "x": 913, "y": 598}, {"label": "common", "x": 1043, "y": 598}, {"label": "common", "x": 1188, "y": 599}, {"label": "image", "x": 16, "y": 703}, {"label": "image", "x": 2266, "y": 392}, {"label": "button", "x": 1233, "y": 20}, {"label": "button", "x": 1271, "y": 19}, {"label": "button", "x": 1396, "y": 19}, {"label": "button", "x": 1519, "y": 19}, {"label": "button", "x": 1560, "y": 18}, {"label": "button", "x": 1600, "y": 19}, {"label": "button", "x": 1697, "y": 19}, {"label": "button", "x": 1781, "y": 10}, {"label": "button", "x": 1781, "y": 27}, {"label": "button", "x": 1882, "y": 18}, {"label": "button", "x": 1966, "y": 10}, {"label": "button", "x": 1966, "y": 26}, {"label": "button", "x": 2019, "y": 19}, {"label": "button", "x": 2042, "y": 19}, {"label": "button", "x": 2070, "y": 19}, {"label": "button", "x": 2094, "y": 19}, {"label": "button", "x": 1255, "y": 59}, {"label": "button", "x": 1326, "y": 59}, {"label": "button", "x": 1410, "y": 60}, {"label": "common", "x": 1554, "y": 60}, {"label": "button", "x": 1257, "y": 647}, {"label": "common", "x": 1327, "y": 647}, {"label": "button", "x": 1420, "y": 648}, {"label": "common", "x": 1547, "y": 647}, {"label": "button", "x": 1696, "y": 647}, {"label": "common", "x": 1775, "y": 647}, {"label": "button", "x": 1963, "y": 646}, {"label": "common", "x": 2024, "y": 647}, {"label": "button", "x": 1426, "y": 592}, {"label": "common", "x": 1453, "y": 593}, {"label": "common", "x": 1512, "y": 594}, {"label": "button", "x": 1801, "y": 592}, {"label": "button", "x": 2062, "y": 588}, {"label": "button", "x": 2062, "y": 599}, {"label": "button", "x": 2028, "y": 687}, {"label": "common", "x": 1594, "y": 688}, {"label": "text-input", "x": 1792, "y": 687}, {"label": "button", "x": 1321, "y": 688}, {"label": "button", "x": 1451, "y": 687}, {"label": "button", "x": 2149, "y": 700}, {"label": "button", "x": 2227, "y": 700}, {"label": "button", "x": 2305, "y": 700}, {"label": "button", "x": 2382, "y": 700}, {"label": "button", "x": 1441, "y": 131}, {"label": "button", "x": 1504, "y": 131}, {"label": "button", "x": 1569, "y": 132}, {"label": "image", "x": 1491, "y": 213}, {"label": "common", "x": 1463, "y": 282}, {"label": "button", "x": 1491, "y": 308}, {"label": "common", "x": 1450, "y": 335}, {"label": "button", "x": 1491, "y": 361}, {"label": "button", "x": 1437, "y": 390}, {"label": "common", "x": 1479, "y": 390}, {"label": "common", "x": 1611, "y": 171}, {"label": "common", "x": 1624, "y": 196}, {"label": "heading", "x": 1584, "y": 229}, {"label": "common", "x": 1610, "y": 260}, {"label": "common", "x": 1618, "y": 287}, {"label": "button", "x": 1826, "y": 259}, {"label": "button", "x": 2010, "y": 254}, {"label": "button", "x": 2011, "y": 266}, {"label": "button", "x": 2030, "y": 273}, {"label": "button", "x": 1828, "y": 286}, {"label": "button", "x": 2011, "y": 281}, {"label": "button", "x": 2012, "y": 292}, {"label": "button", "x": 1847, "y": 169}, {"label": "button", "x": 2050, "y": 163}, {"label": "button", "x": 2050, "y": 174}, {"label": "button", "x": 1846, "y": 195}, {"label": "button", "x": 2051, "y": 190}, {"label": "button", "x": 2051, "y": 199}, {"label": "common", "x": 1622, "y": 334}, {"label": "common", "x": 1620, "y": 362}, {"label": "common", "x": 1601, "y": 389}, {"label": "common", "x": 1617, "y": 415}, {"label": "common", "x": 1616, "y": 442}, {"label": "button", "x": 1847, "y": 334}, {"label": "button", "x": 2050, "y": 329}, {"label": "button", "x": 2051, "y": 340}, {"label": "button", "x": 1836, "y": 286}, {"label": "button", "x": 1847, "y": 361}, {"label": "button", "x": 2051, "y": 356}, {"label": "button", "x": 2052, "y": 365}, {"label": "button", "x": 1846, "y": 387}, {"label": "button", "x": 2051, "y": 382}, {"label": "button", "x": 2052, "y": 392}, {"label": "button", "x": 1847, "y": 414}, {"label": "button", "x": 2051, "y": 409}, {"label": "button", "x": 2052, "y": 419}, {"label": "button", "x": 1658, "y": 440}, {"label": "common", "x": 1685, "y": 441}, {"label": "button", "x": 1878, "y": 441}, {"label": "button", "x": 2050, "y": 436}, {"label": "button", "x": 2051, "y": 446}, {"label": "button", "x": 1275, "y": 128}, {"label": "common", "x": 1337, "y": 129}, {"label": "button", "x": 1338, "y": 142}, {"label": "button", "x": 1339, "y": 157}, {"label": "button", "x": 1339, "y": 173}, {"label": "button", "x": 1339, "y": 188}, {"label": "button", "x": 1338, "y": 202}, {"label": "button", "x": 1339, "y": 217}, {"label": "button", "x": 1339, "y": 231}, {"label": "button", "x": 1339, "y": 245}, {"label": "button", "x": 1337, "y": 261}, {"label": "button", "x": 1337, "y": 275}, {"label": "button", "x": 1338, "y": 290}, {"label": "button", "x": 1338, "y": 305}, {"label": "button", "x": 1275, "y": 320}, {"label": "common", "x": 1340, "y": 321}, {"label": "button", "x": 1338, "y": 335}, {"label": "button", "x": 1338, "y": 350}, {"label": "button", "x": 1337, "y": 365}, {"label": "button", "x": 1337, "y": 379}, {"label": "button", "x": 1337, "y": 394}, {"label": "button", "x": 1337, "y": 408}, {"label": "button", "x": 1337, "y": 423}, {"label": "button", "x": 1337, "y": 438}, {"label": "button", "x": 1337, "y": 453}, {"label": "button", "x": 1274, "y": 468}, {"label": "common", "x": 1339, "y": 470}, {"label": "button", "x": 1338, "y": 484}, {"label": "button", "x": 1338, "y": 498}, {"label": "image", "x": 1278, "y": 202}, {"label": "image", "x": 1279, "y": 499}, {"label": "button", "x": 54, "y": 737}, {"label": "button", "x": 95, "y": 737}, {"label": "button", "x": 146, "y": 737}, {"label": "button", "x": 191, "y": 737}, {"label": "button", "x": 21, "y": 736}, {"label": "button", "x": 227, "y": 736}, {"label": "text-input", "x": 295, "y": 736}, {"label": "button", "x": 358, "y": 736}, {"label": "button", "x": 377, "y": 736}, {"label": "button", "x": 403, "y": 737}, {"label": "button", "x": 533, "y": 736}, {"label": "button", "x": 551, "y": 736}, {"label": "button", "x": 666, "y": 736}, {"label": "image", "x": 697, "y": 737}, {"label": "common", "x": 875, "y": 737}, {"label": "text-input", "x": 617, "y": 737}, {"label": "text-input", "x": 471, "y": 737}, {"label": "button", "x": 1035, "y": 764}, {"label": "button", "x": 1065, "y": 764}, {"label": "button", "x": 1082, "y": 764}, {"label": "button", "x": 1100, "y": 764}, {"label": "button", "x": 1118, "y": 764}, {"label": "button", "x": 1136, "y": 764}, {"label": "button", "x": 1030, "y": 793}, {"label": "image", "x": 1049, "y": 793}, {"label": "common", "x": 1103, "y": 794}, {"label": "heading", "x": 1056, "y": 822}, {"label": "button", "x": 1029, "y": 823}, {"label": "button", "x": 1050, "y": 851}, {"label": "button", "x": 1107, "y": 851}, {"label": "button", "x": 1163, "y": 851}, {"label": "common", "x": 1047, "y": 876}, {"label": "button", "x": 1128, "y": 875}, {"label": "button", "x": 1183, "y": 875}, {"label": "button", "x": 1029, "y": 904}, {"label": "heading", "x": 1067, "y": 905}, {"label": "button", "x": 1089, "y": 933}, {"label": "button", "x": 1166, "y": 933}, {"label": "button", "x": 1183, "y": 933}, {"label": "heading", "x": 1053, "y": 959}, {"label": "heading", "x": 1147, "y": 959}, {"label": "button", "x": 1029, "y": 977}, {"label": "button", "x": 1097, "y": 977}, {"label": "text-input", "x": 1063, "y": 976}, {"label": "button", "x": 1117, "y": 977}, {"label": "button", "x": 1187, "y": 977}, {"label": "text-input", "x": 1150, "y": 977}, {"label": "button", "x": 1029, "y": 995}, {"label": "button", "x": 1096, "y": 995}, {"label": "button", "x": 1117, "y": 995}, {"label": "button", "x": 1187, "y": 995}, {"label": "button", "x": 1117, "y": 1014}, {"label": "button", "x": 1186, "y": 1015}, {"label": "text-input", "x": 1150, "y": 977}, {"label": "text-input", "x": 1152, "y": 995}, {"label": "text-input", "x": 1150, "y": 1015}, {"label": "text-input", "x": 1062, "y": 1015}, {"label": "heading", "x": 1059, "y": 1037}, {"label": "heading", "x": 1144, "y": 1036}, {"label": "button", "x": 1151, "y": 1055}, {"label": "button", "x": 1028, "y": 1055}, {"label": "button", "x": 1096, "y": 1055}, {"label": "text-input", "x": 1061, "y": 1054}, {"label": "button", "x": 1028, "y": 1072}, {"label": "button", "x": 1096, "y": 1072}, {"label": "button", "x": 1061, "y": 1072}, {"label": "button", "x": 1031, "y": 1094}, {"label": "common", "x": 1049, "y": 1094}, {"label": "button", "x": 1075, "y": 1094}, {"label": "common", "x": 1093, "y": 1095}, {"label": "common", "x": 1155, "y": 1075}, {"label": "button", "x": 1116, "y": 1092}, {"label": "button", "x": 1145, "y": 1092}, {"label": "button", "x": 1157, "y": 1092}, {"label": "button", "x": 1187, "y": 1092}, {"label": "common", "x": 1130, "y": 1092}, {"label": "common", "x": 1172, "y": 1091}, {"label": "button", "x": 1207, "y": 824}, {"label": "image", "x": 370, "y": 912}, {"label": "image", "x": 779, "y": 913}, {"label": "button", "x": 22, "y": 1086}, {"label": "button", "x": 55, "y": 1086}, {"label": "button", "x": 99, "y": 1086}, {"label": "button", "x": 147, "y": 1086}, {"label": "button", "x": 198, "y": 1086}, {"label": "button", "x": 241, "y": 1087}, {"label": "button", "x": 296, "y": 1087}, {"label": "button", "x": 345, "y": 1086}, {"label": "button", "x": 361, "y": 1086}, {"label": "button", "x": 380, "y": 1086}, {"label": "button", "x": 402, "y": 1086}, {"label": "button", "x": 446, "y": 1086}, {"label": "button", "x": 491, "y": 1087}, {"label": "common", "x": 525, "y": 1087}, {"label": "button", "x": 567, "y": 1086}, {"label": "common", "x": 602, "y": 1087}, {"label": "button", "x": 634, "y": 1086}, {"label": "button", "x": 651, "y": 1086}, {"label": "button", "x": 673, "y": 1086}, {"label": "button", "x": 692, "y": 1086}, {"label": "button", "x": 710, "y": 1086}, {"label": "button", "x": 732, "y": 1086}, {"label": "button", "x": 749, "y": 1086}, {"label": "button", "x": 768, "y": 1086}, {"label": "button", "x": 786, "y": 1086}, {"label": "button", "x": 807, "y": 1085}, {"label": "button", "x": 825, "y": 1086}, {"label": "button", "x": 844, "y": 1086}, {"label": "button", "x": 950, "y": 1086}, {"label": "text-input", "x": 896, "y": 1086}, {"label": "button", "x": 970, "y": 1086}, {"label": "button", "x": 993, "y": 1086}, {"label": "button", "x": 1008, "y": 1086}, {"label": "button", "x": 539, "y": 779}, {"label": "button", "x": 21, "y": 1113}, {"label": "button", "x": 57, "y": 1113}, {"label": "button", "x": 99, "y": 1113}, {"label": "button", "x": 147, "y": 1113}, {"label": "button", "x": 199, "y": 1113}, {"label": "button", "x": 240, "y": 1113}, {"label": "button", "x": 256, "y": 1114}, {"label": "button", "x": 279, "y": 1113}, {"label": "button", "x": 369, "y": 1114}, {"label": "button", "x": 381, "y": 1113}, {"label": "button", "x": 466, "y": 1113}, {"label": "button", "x": 486, "y": 1113}, {"label": "button", "x": 553, "y": 1114}, {"label": "button", "x": 583, "y": 1114}, {"label": "button", "x": 599, "y": 1114}, {"label": "button", "x": 618, "y": 1114}, {"label": "button", "x": 635, "y": 1113}, {"label": "button", "x": 652, "y": 1113}, {"label": "button", "x": 671, "y": 1114}, {"label": "button", "x": 736, "y": 1113}, {"label": "button", "x": 810, "y": 1113}, {"label": "button", "x": 881, "y": 1113}, {"label": "button", "x": 948, "y": 1113}, {"label": "button", "x": 966, "y": 1114}, {"label": "button", "x": 9, "y": 1238}, {"label": "button", "x": 588, "y": 1250}, {"label": "button", "x": 454, "y": 1290}, {"label": "button", "x": 701, "y": 1290}, {"label": "button", "x": 353, "y": 1331}, {"label": "button", "x": 605, "y": 1331}, {"label": "button", "x": 239, "y": 1371}, {"label": "button", "x": 300, "y": 1372}, {"label": "button", "x": 338, "y": 1372}, {"label": "button", "x": 375, "y": 1372}, {"label": "button", "x": 502, "y": 1372}, {"label": "button", "x": 632, "y": 1373}, {"label": "button", "x": 675, "y": 1372}, {"label": "button", "x": 733, "y": 1372}, {"label": "button", "x": 1032, "y": 1145}, {"label": "common", "x": 1068, "y": 1146}, {"label": "heading", "x": 1069, "y": 1171}, {"label": "button", "x": 1029, "y": 1190}, {"label": "text-input", "x": 1107, "y": 1190}, {"label": "button", "x": 1187, "y": 1190}, {"label": "heading", "x": 1075, "y": 1215}, {"label": "common", "x": 1053, "y": 1237}, {"label": "button", "x": 1138, "y": 1237}, {"label": "button", "x": 1108, "y": 1261}, {"label": "button", "x": 1108, "y": 1282}, {"label": "button", "x": 1030, "y": 1311}, {"label": "heading", "x": 1062, "y": 1310}, {"label": "button", "x": 1031, "y": 1340}, {"label": "common", "x": 1093, "y": 1341}, {"label": "button", "x": 1107, "y": 1363}, {"label": "button", "x": 1108, "y": 1389}, {"label": "button", "x": 1029, "y": 1417}, {"label": "heading", "x": 1084, "y": 1417}, {"label": "button", "x": 20, "y": 1437}, {"label": "button", "x": 57, "y": 1438}, {"label": "button", "x": 99, "y": 1437}, {"label": "button", "x": 146, "y": 1437}, {"label": "button", "x": 188, "y": 1437}, {"label": "button", "x": 229, "y": 1437}, {"label": "button", "x": 270, "y": 1438}, {"label": "button", "x": 301, "y": 1438}, {"label": "button", "x": 318, "y": 1438}, {"label": "button", "x": 340, "y": 1438}, {"label": "button", "x": 358, "y": 1437}, {"label": "button", "x": 377, "y": 1437}, {"label": "button", "x": 398, "y": 1438}, {"label": "button", "x": 416, "y": 1438}, {"label": "button", "x": 494, "y": 1437}, {"label": "button", "x": 561, "y": 1437}, {"label": "common", "x": 605, "y": 1439}, {"label": "button", "x": 657, "y": 1438}, {"label": "button", "x": 675, "y": 1437}, {"label": "text-input", "x": 1804, "y": 1163}, {"label": "button", "x": 2424, "y": 1004}, {"label": "button", "x": 1231, "y": 736}, {"label": "button", "x": 1249, "y": 736}, {"label": "button", "x": 1266, "y": 736}, {"label": "common", "x": 1315, "y": 736}, {"label": "button", "x": 1359, "y": 736}, {"label": "button", "x": 1393, "y": 736}, {"label": "button", "x": 1415, "y": 736}, {"label": "button", "x": 1437, "y": 736}, {"label": "button", "x": 1452, "y": 736}, {"label": "button", "x": 1468, "y": 736}, {"label": "button", "x": 1491, "y": 736}, {"label": "button", "x": 1512, "y": 737}, {"label": "heading", "x": 1793, "y": 736}, {"label": "common", "x": 1872, "y": 737}, {"label": "button", "x": 1895, "y": 736}, {"label": "image", "x": 2413, "y": 736}, {"label": "button", "x": 2220, "y": 736}, {"label": "text-input", "x": 2313, "y": 736}, {"label": "button", "x": 2300, "y": 761}, {"label": "button", "x": 2380, "y": 761}, {"label": "button", "x": 2364, "y": 800}, {"label": "button", "x": 1836, "y": 760}, {"label": "button", "x": 1750, "y": 758}, {"label": "button", "x": 1716, "y": 760}, {"label": "button", "x": 1664, "y": 760}, {"label": "button", "x": 1600, "y": 761}, {"label": "button", "x": 1526, "y": 761}, {"label": "button", "x": 1456, "y": 760}, {"label": "button", "x": 1398, "y": 761}, {"label": "button", "x": 1344, "y": 761}, {"label": "button", "x": 1294, "y": 761}, {"label": "button", "x": 1241, "y": 763}, {"label": "button", "x": 1246, "y": 796}, {"label": "button", "x": 1259, "y": 789}, {"label": "button", "x": 1276, "y": 783}, {"label": "button", "x": 1277, "y": 801}, {"label": "button", "x": 1276, "y": 816}, {"label": "button", "x": 1314, "y": 812}, {"label": "button", "x": 1337, "y": 812}, {"label": "button", "x": 1359, "y": 812}, {"label": "button", "x": 1376, "y": 813}, {"label": "button", "x": 1392, "y": 813}, {"label": "button", "x": 1417, "y": 813}, {"label": "button", "x": 1440, "y": 811}, {"label": "button", "x": 1473, "y": 812}, {"label": "button", "x": 1489, "y": 813}, {"label": "button", "x": 1507, "y": 813}, {"label": "button", "x": 1522, "y": 812}, {"label": "button", "x": 1540, "y": 812}, {"label": "button", "x": 1555, "y": 812}, {"label": "button", "x": 1554, "y": 787}, {"label": "button", "x": 1509, "y": 787}, {"label": "button", "x": 1525, "y": 788}, {"label": "button", "x": 1452, "y": 787}, {"label": "button", "x": 1475, "y": 787}, {"label": "common", "x": 1341, "y": 787}, {"label": "button", "x": 1384, "y": 788}, {"label": "text-input", "x": 1410, "y": 788}, {"label": "button", "x": 1433, "y": 788}, {"label": "button", "x": 1594, "y": 787}, {"label": "button", "x": 1610, "y": 787}, {"label": "button", "x": 1628, "y": 787}, {"label": "button", "x": 1642, "y": 788}, {"label": "button", "x": 1661, "y": 788}, {"label": "button", "x": 1675, "y": 788}, {"label": "button", "x": 1594, "y": 812}, {"label": "button", "x": 1616, "y": 812}, {"label": "button", "x": 1639, "y": 812}, {"label": "button", "x": 1662, "y": 812}, {"label": "button", "x": 1698, "y": 812}, {"label": "button", "x": 1713, "y": 813}, {"label": "button", "x": 1744, "y": 811}, {"label": "button", "x": 1759, "y": 813}, {"label": "button", "x": 1776, "y": 812}, {"label": "button", "x": 1792, "y": 813}, {"label": "button", "x": 1706, "y": 787}, {"label": "button", "x": 1729, "y": 788}, {"label": "button", "x": 1765, "y": 787}, {"label": "button", "x": 1801, "y": 788}, {"label": "button", "x": 1879, "y": 798}, {"label": "button", "x": 1949, "y": 798}, {"label": "button", "x": 2018, "y": 798}, {"label": "button", "x": 2087, "y": 798}, {"label": "button", "x": 2157, "y": 798}, {"label": "button", "x": 2226, "y": 798}, {"label": "button", "x": 2296, "y": 798}, {"label": "button", "x": 2338, "y": 798}, {"label": "common", "x": 2396, "y": 1440}, {"label": "button", "x": 2364, "y": 1439}, {"label": "button", "x": 2316, "y": 1439}, {"label": "button", "x": 2258, "y": 1439}, {"label": "button", "x": 2232, "y": 1440}, {"label": "button", "x": 2201, "y": 1440}, {"label": "button", "x": 2170, "y": 1440}, {"label": "button", "x": 2138, "y": 1440}, {"label": "image", "x": 2072, "y": 1439}, {"label": "common", "x": 2099, "y": 1440}, {"label": "common", "x": 1445, "y": 1440}, {"label": "image", "x": 1380, "y": 1439}, {"label": "common", "x": 1332, "y": 1440}, {"label": "common", "x": 1262, "y": 1440}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "button", "x": 15, "y": 15}, {"label": "heading", "x": 180, "y": 15}, {"label": "button", "x": 27, "y": 39}, {"label": "button", "x": 81, "y": 39}, {"label": "button", "x": 142, "y": 39}, {"label": "button", "x": 202, "y": 39}, {"label": "button", "x": 267, "y": 39}, {"label": "button", "x": 321, "y": 39}, {"label": "button", "x": 360, "y": 39}, {"label": "button", "x": 47, "y": 62}, {"label": "button", "x": 91, "y": 62}, {"label": "button", "x": 145, "y": 62}, {"label": "button", "x": 239, "y": 62}, {"label": "button", "x": 352, "y": 62}, {"label": "image", "x": 1134, "y": 40}, {"label": "button", "x": 1058, "y": 10}, {"label": "button", "x": 1085, "y": 10}, {"label": "button", "x": 1123, "y": 10}, {"label": "text-input", "x": 916, "y": 62}, {"label": "button", "x": 1130, "y": 62}, {"label": "button", "x": 136, "y": 89}, {"label": "common", "x": 58, "y": 116}, {"label": "button", "x": 203, "y": 114}, {"label": "button", "x": 229, "y": 114}, {"label": "button", "x": 76, "y": 140}, {"label": "button", "x": 15, "y": 162}, {"label": "button", "x": 116, "y": 180}, {"label": "button", "x": 58, "y": 241}, {"label": "button", "x": 67, "y": 220}, {"label": "button", "x": 65, "y": 200}, {"label": "button", "x": 27, "y": 241}, {"label": "button", "x": 66, "y": 260}, {"label": "button", "x": 71, "y": 279}, {"label": "button", "x": 66, "y": 300}, {"label": "button", "x": 55, "y": 320}, {"label": "button", "x": 83, "y": 340}, {"label": "button", "x": 15, "y": 361}, {"label": "button", "x": 65, "y": 360}, {"label": "button", "x": 71, "y": 380}, {"label": "button", "x": 127, "y": 401}, {"label": "button", "x": 16, "y": 421}, {"label": "button", "x": 96, "y": 422}, {"label": "button", "x": 87, "y": 162}, {"label": "button", "x": 75, "y": 440}, {"label": "button", "x": 65, "y": 460}, {"label": "button", "x": 67, "y": 481}, {"label": "button", "x": 28, "y": 501}, {"label": "button", "x": 58, "y": 500}, {"label": "button", "x": 66, "y": 519}, {"label": "button", "x": 71, "y": 539}, {"label": "button", "x": 58, "y": 560}, {"label": "button", "x": 65, "y": 580}, {"label": "button", "x": 64, "y": 601}, {"label": "button", "x": 67, "y": 621}, {"label": "button", "x": 80, "y": 641}, {"label": "button", "x": 16, "y": 661}, {"label": "button", "x": 70, "y": 660}, {"label": "button", "x": 70, "y": 681}, {"label": "button", "x": 76, "y": 700}, {"label": "button", "x": 234, "y": 711}, {"label": "button", "x": 232, "y": 598}, {"label": "image", "x": 19, "y": 732}, {"label": "button", "x": 233, "y": 137}, {"label": "table-cell", "x": 250, "y": 113}, {"label": "table-cell", "x": 251, "y": 135}, {"label": "table-cell", "x": 268, "y": 135}, {"label": "table-cell", "x": 267, "y": 113}, {"label": "table-cell", "x": 285, "y": 113}, {"label": "table-cell", "x": 285, "y": 135}, {"label": "table-cell", "x": 564, "y": 114}, {"label": "table-cell", "x": 564, "y": 135}, {"label": "table-cell", "x": 844, "y": 114}, {"label": "table-cell", "x": 935, "y": 114}, {"label": "table-cell", "x": 1027, "y": 114}, {"label": "table-cell", "x": 844, "y": 136}, {"label": "table-cell", "x": 935, "y": 136}, {"label": "table-cell", "x": 1027, "y": 136}, {"label": "table-cell", "x": 1081, "y": 114}, {"label": "table-cell", "x": 1081, "y": 136}, {"label": "table-cell", "x": 1136, "y": 114}, {"label": "table-cell", "x": 1136, "y": 136}, {"label": "table-row", "x": 694, "y": 114}, {"label": "table-row", "x": 694, "y": 137}, {"label": "table", "x": 694, "y": 124}, {"label": "button", "x": 1103, "y": 89}, {"label": "button", "x": 1134, "y": 89}, {"label": "table-cell", "x": 277, "y": 270}, {"label": "table-cell", "x": 437, "y": 270}, {"label": "button", "x": 359, "y": 268}, {"label": "table-cell", "x": 277, "y": 292}, {"label": "table-cell", "x": 437, "y": 292}, {"label": "table-cell", "x": 277, "y": 315}, {"label": "table-cell", "x": 437, "y": 315}, {"label": "table-cell", "x": 277, "y": 338}, {"label": "table-cell", "x": 437, "y": 338}, {"label": "button", "x": 552, "y": 315}, {"label": "button", "x": 461, "y": 338}, {"label": "table-row", "x": 405, "y": 269}, {"label": "table-row", "x": 405, "y": 291}, {"label": "table-row", "x": 405, "y": 314}, {"label": "table-row", "x": 405, "y": 337}, {"label": "table", "x": 405, "y": 304}, {"label": "button", "x": 763, "y": 259}, {"label": "button", "x": 812, "y": 259}, {"label": "button", "x": 869, "y": 260}, {"label": "button", "x": 964, "y": 260}, {"label": "button", "x": 1039, "y": 260}, {"label": "button", "x": 1107, "y": 260}, {"label": "common", "x": 1094, "y": 291}, {"label": "button", "x": 1079, "y": 332}, {"label": "common", "x": 492, "y": 368}, {"label": "button", "x": 494, "y": 368}, {"label": "heading", "x": 508, "y": 408}, {"label": "heading", "x": 586, "y": 436}, {"label": "heading", "x": 537, "y": 499}, {"label": "common", "x": 512, "y": 630}, {"label": "button", "x": 513, "y": 567}, {"label": "button", "x": 428, "y": 668}, {"label": "button", "x": 499, "y": 668}, {"label": "button", "x": 572, "y": 702}, {"label": "button", "x": 426, "y": 716}, {"label": "button", "x": 546, "y": 716}, {"label": "image", "x": 711, "y": 625}, {"label": "heading", "x": 934, "y": 408}, {"label": "heading", "x": 895, "y": 485}, {"label": "common", "x": 876, "y": 529}, {"label": "common", "x": 893, "y": 560}, {"label": "common", "x": 895, "y": 589}, {"label": "common", "x": 898, "y": 621}, {"label": "common", "x": 895, "y": 652}, {"label": "common", "x": 899, "y": 691}, {"label": "button", "x": 1136, "y": 361}, {"label": "button", "x": 1136, "y": 383}, {"label": "button", "x": 1137, "y": 712}, {"label": "button", "x": 1139, "y": 736}, {"label": "common", "x": 1011, "y": 731}, {"label": "common", "x": 1092, "y": 731}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "text-input", "x": 1357, "y": 744}, {"label": "button", "x": 2786, "y": 1159}, {"label": "button", "x": 38, "y": 1856}, {"label": "button", "x": 79, "y": 1856}, {"label": "button", "x": 118, "y": 1856}, {"label": "common", "x": 230, "y": 1856}, {"label": "button", "x": 332, "y": 1857}, {"label": "button", "x": 410, "y": 1857}, {"label": "button", "x": 460, "y": 1857}, {"label": "button", "x": 513, "y": 1857}, {"label": "button", "x": 547, "y": 1856}, {"label": "button", "x": 584, "y": 1857}, {"label": "button", "x": 636, "y": 1857}, {"label": "button", "x": 685, "y": 1854}, {"label": "heading", "x": 1332, "y": 1855}, {"label": "common", "x": 1513, "y": 1854}, {"label": "button", "x": 1566, "y": 1857}, {"label": "image", "x": 2762, "y": 1856}, {"label": "button", "x": 2316, "y": 1857}, {"label": "text-input", "x": 2531, "y": 1857}, {"label": "button", "x": 2502, "y": 1792}, {"label": "button", "x": 2684, "y": 1792}, {"label": "button", "x": 2647, "y": 1691}, {"label": "button", "x": 1431, "y": 1793}, {"label": "button", "x": 1233, "y": 1798}, {"label": "button", "x": 1156, "y": 1794}, {"label": "button", "x": 1034, "y": 1793}, {"label": "button", "x": 888, "y": 1792}, {"label": "button", "x": 717, "y": 1792}, {"label": "button", "x": 556, "y": 1793}, {"label": "button", "x": 422, "y": 1792}, {"label": "button", "x": 298, "y": 1790}, {"label": "button", "x": 182, "y": 1792}, {"label": "button", "x": 60, "y": 1786}, {"label": "button", "x": 72, "y": 1701}, {"label": "button", "x": 102, "y": 1718}, {"label": "button", "x": 141, "y": 1735}, {"label": "button", "x": 144, "y": 1688}, {"label": "button", "x": 142, "y": 1648}, {"label": "button", "x": 227, "y": 1659}, {"label": "button", "x": 282, "y": 1659}, {"label": "button", "x": 333, "y": 1658}, {"label": "button", "x": 370, "y": 1656}, {"label": "button", "x": 409, "y": 1656}, {"label": "button", "x": 465, "y": 1655}, {"label": "button", "x": 518, "y": 1662}, {"label": "button", "x": 596, "y": 1659}, {"label": "button", "x": 631, "y": 1656}, {"label": "button", "x": 674, "y": 1657}, {"label": "button", "x": 709, "y": 1657}, {"label": "button", "x": 749, "y": 1657}, {"label": "button", "x": 784, "y": 1659}, {"label": "button", "x": 781, "y": 1722}, {"label": "button", "x": 678, "y": 1724}, {"label": "button", "x": 713, "y": 1721}, {"label": "button", "x": 547, "y": 1724}, {"label": "button", "x": 599, "y": 1725}, {"label": "common", "x": 290, "y": 1723}, {"label": "button", "x": 389, "y": 1722}, {"label": "text-input", "x": 450, "y": 1722}, {"label": "button", "x": 501, "y": 1721}, {"label": "button", "x": 873, "y": 1724}, {"label": "button", "x": 910, "y": 1723}, {"label": "button", "x": 951, "y": 1722}, {"label": "button", "x": 985, "y": 1721}, {"label": "button", "x": 1028, "y": 1722}, {"label": "button", "x": 1060, "y": 1722}, {"label": "button", "x": 874, "y": 1658}, {"label": "button", "x": 925, "y": 1658}, {"label": "button", "x": 977, "y": 1657}, {"label": "button", "x": 1030, "y": 1659}, {"label": "button", "x": 1113, "y": 1658}, {"label": "button", "x": 1149, "y": 1657}, {"label": "button", "x": 1220, "y": 1661}, {"label": "button", "x": 1254, "y": 1656}, {"label": "button", "x": 1293, "y": 1659}, {"label": "button", "x": 1331, "y": 1657}, {"label": "button", "x": 1132, "y": 1722}, {"label": "button", "x": 1184, "y": 1721}, {"label": "button", "x": 1266, "y": 1722}, {"label": "button", "x": 1349, "y": 1721}, {"label": "button", "x": 1530, "y": 1696}, {"label": "button", "x": 1691, "y": 1695}, {"label": "button", "x": 1850, "y": 1696}, {"label": "button", "x": 2009, "y": 1696}, {"label": "button", "x": 2171, "y": 1695}, {"label": "button", "x": 2329, "y": 1696}, {"label": "button", "x": 2490, "y": 1696}, {"label": "button", "x": 2588, "y": 1695}, {"label": "common", "x": 2721, "y": 22}, {"label": "button", "x": 2648, "y": 23}, {"label": "button", "x": 2537, "y": 23}, {"label": "button", "x": 2404, "y": 23}, {"label": "button", "x": 2343, "y": 22}, {"label": "button", "x": 2273, "y": 22}, {"label": "button", "x": 2202, "y": 22}, {"label": "button", "x": 2128, "y": 22}, {"label": "image", "x": 1975, "y": 23}, {"label": "common", "x": 2037, "y": 20}, {"label": "common", "x": 531, "y": 22}, {"label": "image", "x": 381, "y": 23}, {"label": "common", "x": 269, "y": 22}, {"label": "common", "x": 109, "y": 20}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to identify clickable UI elements from screenshots and return their coordinates.

[User] List all UI elements visible in this screenshot and return them in a JSON array with their label and clickable center coordinates (x, y in pixels).

[Assistant] [{"label": "heading", "x": 961, "y": 16}, {"label": "button", "x": 1836, "y": 17}, {"label": "button", "x": 1868, "y": 17}, {"label": "button", "x": 1902, "y": 17}, {"label": "button", "x": 23, "y": 47}, {"label": "button", "x": 58, "y": 47}, {"label": "button", "x": 106, "y": 47}, {"label": "button", "x": 163, "y": 47}, {"label": "button", "x": 214, "y": 47}, {"label": "button", "x": 255, "y": 46}, {"label": "text-input", "x": 330, "y": 47}, {"label": "button", "x": 401, "y": 46}, {"label": "button", "x": 420, "y": 46}, {"label": "button", "x": 452, "y": 46}, {"label": "text-input", "x": 528, "y": 46}, {"label": "button", "x": 598, "y": 46}, {"label": "button", "x": 618, "y": 46}, {"label": "button", "x": 700, "y": 46}, {"label": "image", "x": 781, "y": 47}, {"label": "common", "x": 813, "y": 47}, {"label": "common", "x": 856, "y": 47}, {"label": "common", "x": 903, "y": 47}, {"label": "common", "x": 944, "y": 47}, {"label": "common", "x": 996, "y": 47}, {"label": "common", "x": 1061, "y": 47}, {"label": "common", "x": 1127, "y": 47}, {"label": "image", "x": 169, "y": 512}, {"label": "button", "x": 329, "y": 88}, {"label": "button", "x": 348, "y": 83}, {"label": "button", "x": 348, "y": 128}, {"label": "button", "x": 348, "y": 184}, {"label": "button", "x": 348, "y": 248}, {"label": "button", "x": 348, "y": 308}, {"label": "button", "x": 348, "y": 377}, {"label": "button", "x": 348, "y": 448}, {"label": "button", "x": 348, "y": 496}, {"label": "button", "x": 374, "y": 72}, {"label": "button", "x": 374, "y": 197}, {"label": "button", "x": 373, "y": 297}, {"label": "button", "x": 374, "y": 320}, {"label": "common", "x": 410, "y": 72}, {"label": "common", "x": 394, "y": 197}, {"label": "common", "x": 402, "y": 297}, {"label": "common", "x": 427, "y": 320}, {"label": "button", "x": 426, "y": 101}, {"label": "button", "x": 426, "y": 121}, {"label": "button", "x": 426, "y": 141}, {"label": "button", "x": 426, "y": 166}, {"label": "button", "x": 426, "y": 226}, {"label": "button", "x": 426, "y": 246}, {"label": "button", "x": 426, "y": 266}, {"label": "button", "x": 6, "y": 89}, {"label": "button", "x": 353, "y": 548}, {"label": "common", "x": 386, "y": 549}, {"label": "button", "x": 23, "y": 981}, {"label": "button", "x": 61, "y": 981}, {"label": "button", "x": 110, "y": 981}, {"label": "button", "x": 154, "y": 981}, {"label": "button", "x": 200, "y": 982}, {"label": "button", "x": 260, "y": 982}, {"label": "button", "x": 306, "y": 982}, {"label": "button", "x": 328, "y": 982}, {"label": "button", "x": 343, "y": 808}, {"label": "button", "x": 620, "y": 86}, {"label": "button", "x": 620, "y": 109}, {"label": "button", "x": 620, "y": 130}, {"label": "button", "x": 620, "y": 152}, {"label": "button", "x": 620, "y": 177}, {"label": "button", "x": 620, "y": 199}, {"label": "button", "x": 620, "y": 221}, {"label": "button", "x": 620, "y": 247}, {"label": "button", "x": 620, "y": 276}, {"label": "button", "x": 620, "y": 303}, {"label": "button", "x": 620, "y": 326}, {"label": "button", "x": 620, "y": 346}, {"label": "button", "x": 620, "y": 368}, {"label": "button", "x": 620, "y": 393}, {"label": "button", "x": 620, "y": 416}, {"label": "button", "x": 620, "y": 436}, {"label": "button", "x": 620, "y": 456}, {"label": "button", "x": 620, "y": 475}, {"label": "button", "x": 620, "y": 495}, {"label": "button", "x": 620, "y": 516}, {"label": "button", "x": 620, "y": 537}, {"label": "button", "x": 620, "y": 563}, {"label": "button", "x": 620, "y": 591}, {"label": "button", "x": 620, "y": 613}, {"label": "button", "x": 620, "y": 633}, {"label": "button", "x": 620, "y": 653}, {"label": "button", "x": 620, "y": 674}, {"label": "button", "x": 620, "y": 700}, {"label": "button", "x": 620, "y": 721}, {"label": "button", "x": 620, "y": 743}, {"label": "image", "x": 1196, "y": 405}, {"label": "button", "x": 1656, "y": 89}, {"label": "button", "x": 360, "y": 765}, {"label": "button", "x": 400, "y": 765}, {"label": "button", "x": 449, "y": 765}, {"label": "button", "x": 495, "y": 765}, {"label": "button", "x": 540, "y": 765}, {"label": "button", "x": 625, "y": 765}, {"label": "button", "x": 704, "y": 765}, {"label": "button", "x": 744, "y": 765}, {"label": "button", "x": 772, "y": 765}, {"label": "button", "x": 797, "y": 765}, {"label": "button", "x": 817, "y": 765}, {"label": "button", "x": 837, "y": 765}, {"label": "button", "x": 857, "y": 765}, {"label": "button", "x": 903, "y": 765}, {"label": "button", "x": 1064, "y": 765}, {"label": "image", "x": 968, "y": 765}, {"label": "image", "x": 1024, "y": 765}, {"label": "button", "x": 1089, "y": 765}, {"label": "button", "x": 1116, "y": 765}, {"label": "button", "x": 1148, "y": 765}, {"label": "button", "x": 1169, "y": 765}, {"label": "button", "x": 1689, "y": 72}, {"label": "button", "x": 1729, "y": 72}, {"label": "button", "x": 1778, "y": 72}, {"label": "button", "x": 1864, "y": 72}, {"label": "image", "x": 1871, "y": 156}, {"label": "image", "x": 1890, "y": 156}, {"label": "image", "x": 1910, "y": 156}, {"label": "button", "x": 1770, "y": 117}, {"label": "button", "x": 1754, "y": 156}, {"label": "button", "x": 1734, "y": 138}, {"label": "button", "x": 1772, "y": 96}, {"label": "button", "x": 1773, "y": 222}, {"label": "button", "x": 1689, "y": 246}, {"label": "button", "x": 1722, "y": 246}, {"label": "button", "x": 1742, "y": 246}, {"label": "button", "x": 1762, "y": 246}, {"label": "button", "x": 1782, "y": 246}, {"label": "button", "x": 1802, "y": 246}, {"label": "button", "x": 1682, "y": 277}, {"label": "image", "x": 1704, "y": 277}, {"label": "common", "x": 1736, "y": 277}, {"label": "button", "x": 1682, "y": 307}, {"label": "common", "x": 1710, "y": 307}, {"label": "button", "x": 1712, "y": 337}, {"label": "button", "x": 1791, "y": 337}, {"label": "button", "x": 1872, "y": 337}, {"label": "common", "x": 1700, "y": 364}, {"label": "button", "x": 1824, "y": 363}, {"label": "button", "x": 1902, "y": 363}, {"label": "button", "x": 1682, "y": 392}, {"label": "common", "x": 1723, "y": 392}, {"label": "button", "x": 1772, "y": 423}, {"label": "button", "x": 1882, "y": 423}, {"label": "button", "x": 1902, "y": 423}, {"label": "common", "x": 1708, "y": 448}, {"label": "common", "x": 1838, "y": 448}, {"label": "button", "x": 1680, "y": 467}, {"label": "button", "x": 1680, "y": 486}, {"label": "button", "x": 1781, "y": 468}, {"label": "button", "x": 1781, "y": 486}, {"label": "common", "x": 1729, "y": 468}, {"label": "common", "x": 1729, "y": 487}, {"label": "button", "x": 1730, "y": 508}, {"label": "button", "x": 1804, "y": 468}, {"label": "button", "x": 1804, "y": 487}, {"label": "button", "x": 1804, "y": 508}, {"label": "button", "x": 1904, "y": 468}, {"label": "button", "x": 1904, "y": 488}, {"label": "button", "x": 1904, "y": 508}, {"label": "common", "x": 1854, "y": 468}, {"label": "common", "x": 1854, "y": 488}, {"label": "common", "x": 1854, "y": 508}, {"label": "button", "x": 1693, "y": 157}, {"label": "button", "x": 1695, "y": 117}, {"label": "button", "x": 1674, "y": 96}, {"label": "common", "x": 1713, "y": 529}, {"label": "common", "x": 1836, "y": 529}, {"label": "common", "x": 1847, "y": 569}, {"label": "button", "x": 1803, "y": 589}, {"label": "button", "x": 1847, "y": 589}, {"label": "button", "x": 1861, "y": 589}, {"label": "button", "x": 1905, "y": 588}, {"label": "common", "x": 1824, "y": 589}, {"label": "common", "x": 1883, "y": 589}, {"label": "button", "x": 1680, "y": 547}, {"label": "button", "x": 1781, "y": 547}, {"label": "common", "x": 1730, "y": 547}, {"label": "button", "x": 1680, "y": 567}, {"label": "button", "x": 1781, "y": 568}, {"label": "common", "x": 1730, "y": 568}, {"label": "button", "x": 1854, "y": 548}, {"label": "button", "x": 1682, "y": 620}, {"label": "button", "x": 1736, "y": 621}, {"label": "button", "x": 1687, "y": 650}, {"label": "button", "x": 1715, "y": 650}, {"label": "button", "x": 1743, "y": 650}, {"label": "button", "x": 1772, "y": 650}, {"label": "button", "x": 1716, "y": 673}, {"label": "button", "x": 1854, "y": 650}, {"label": "button", "x": 1802, "y": 672}, {"label": "button", "x": 1905, "y": 673}, {"label": "button", "x": 1681, "y": 702}, {"label": "button", "x": 1759, "y": 702}, {"label": "button", "x": 1681, "y": 727}, {"label": "button", "x": 1681, "y": 750}, {"label": "button", "x": 1681, "y": 774}, {"label": "button", "x": 1681, "y": 799}, {"label": "button", "x": 1718, "y": 798}, {"label": "button", "x": 1682, "y": 822}, {"label": "common", "x": 1710, "y": 823}, {"label": "common", "x": 1734, "y": 774}, {"label": "common", "x": 1726, "y": 750}, {"label": "common", "x": 1712, "y": 727}, {"label": "text-input", "x": 1782, "y": 852}, {"label": "button", "x": 1902, "y": 852}, {"label": "button", "x": 1730, "y": 924}, {"label": "button", "x": 1815, "y": 924}, {"label": "button", "x": 1853, "y": 924}, {"label": "button", "x": 1892, "y": 924}, {"label": "button", "x": 1793, "y": 968}, {"label": "common", "x": 1711, "y": 947}, {"label": "button", "x": 1796, "y": 946}, {"label": "button", "x": 1873, "y": 946}, {"label": "button", "x": 1682, "y": 1000}, {"label": "common", "x": 1706, "y": 1000}, {"label": "button", "x": 1682, "y": 1024}, {"label": "button", "x": 24, "y": 1042}, {"label": "button", "x": 64, "y": 1042}, {"label": "button", "x": 114, "y": 1042}, {"label": "button", "x": 168, "y": 1042}, {"label": "button", "x": 226, "y": 1042}, {"label": "button", "x": 271, "y": 1042}, {"label": "button", "x": 291, "y": 1042}, {"label": "button", "x": 313, "y": 1042}, {"label": "button", "x": 415, "y": 1043}, {"label": "button", "x": 430, "y": 1043}, {"label": "button", "x": 528, "y": 1043}, {"label": "common", "x": 479, "y": 1043}, {"label": "common", "x": 365, "y": 1042}, {"label": "button", "x": 546, "y": 1042}, {"label": "button", "x": 622, "y": 1042}, {"label": "common", "x": 584, "y": 1042}, {"label": "button", "x": 654, "y": 1042}, {"label": "button", "x": 674, "y": 1042}, {"label": "button", "x": 695, "y": 1042}, {"label": "button", "x": 714, "y": 1042}, {"label": "button", "x": 734, "y": 1042}, {"label": "button", "x": 755, "y": 1042}, {"label": "button", "x": 828, "y": 1042}, {"label": "button", "x": 911, "y": 1042}, {"label": "button", "x": 991, "y": 1042}, {"label": "button", "x": 1067, "y": 1042}, {"label": "button", "x": 1086, "y": 1042}, {"label": "button", "x": 359, "y": 981}, {"label": "button", "x": 400, "y": 982}, {"label": "button", "x": 448, "y": 983}, {"label": "button", "x": 492, "y": 983}, {"label": "button", "x": 535, "y": 983}, {"label": "button", "x": 570, "y": 982}, {"label": "button", "x": 590, "y": 982}, {"label": "button", "x": 611, "y": 982}, {"label": "button", "x": 636, "y": 982}, {"label": "button", "x": 661, "y": 982}, {"label": "button", "x": 697, "y": 982}, {"label": "button", "x": 725, "y": 982}, {"label": "button", "x": 757, "y": 982}, {"label": "button", "x": 777, "y": 982}, {"label": "button", "x": 1654, "y": 834}, {"label": "button", "x": 1474, "y": 837}, {"label": "button", "x": 902, "y": 958}, {"label": "common", "x": 836, "y": 1019}, {"label": "button", "x": 1697, "y": 1024}, {"label": "common", "x": 1736, "y": 1024}, {"label": "button", "x": 1683, "y": 877}, {"label": "button", "x": 1682, "y": 898}, {"label": "button", "x": 1806, "y": 876}, {"label": "button", "x": 1806, "y": 898}, {"label": "common", "x": 1859, "y": 878}, {"label": "common", "x": 1723, "y": 878}, {"label": "common", "x": 1730, "y": 900}, {"label": "common", "x": 1854, "y": 900}, {"label": "button", "x": 1683, "y": 590}, {"label": "button", "x": 1744, "y": 590}, {"label": "common", "x": 1710, "y": 591}, {"label": "common", "x": 1771, "y": 591}]


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'copy the file' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [318, 83]}], "status_update": "Clicked to complete task: 'copy the file'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'set the screen timeout.' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [390, 192]}], "status_update": "Clicked to complete task: 'set the screen timeout.'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'turn on the mixed reality' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [777, 49]}], "status_update": "Clicked to complete task: 'turn on the mixed reality'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'edit with paint 3d' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [650, 95]}], "status_update": "Clicked to complete task: 'edit with paint 3d'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'search for files' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [152, 50]}], "status_update": "Clicked to complete task: 'search for files'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open fax' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [440, 301]}], "status_update": "Clicked to complete task: 'open fax'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'adjust the volume' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [130, 416]}], "status_update": "Clicked to complete task: 'adjust the volume'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'switch to feedback' in this screenshot from windows using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [159, 179]}], "status_update": "Clicked to complete task: 'switch to feedback'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'check the battery' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [674, 38]}], "status_update": "Clicked to complete task: 'check the battery'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'help' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [743, 38]}], "status_update": "Clicked to complete task: 'help'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'add a device' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [62, 1116]}], "status_update": "Clicked to complete task: 'add a device'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open user apple watch to unlock' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [548, 428]}], "status_update": "Clicked to complete task: 'open user apple watch to unlock'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'search in app store' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [220, 132]}], "status_update": "Clicked to complete task: 'search in app store'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'adjust orientation' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [284, 191]}], "status_update": "Clicked to complete task: 'adjust orientation'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'input the email address' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [576, 295]}], "status_update": "Clicked to complete task: 'input the email address'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'start record' in this screenshot from macos using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [246, 1188]}], "status_update": "Clicked to complete task: 'start record'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'select source language' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1123, 136]}], "status_update": "Clicked to complete task: 'select source language'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'add a new file' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1510, 100]}], "status_update": "Clicked to complete task: 'add a new file'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'back to settings' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [149, 206]}], "status_update": "Clicked to complete task: 'back to settings'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'switch to 0.5x' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [524, 1820]}], "status_update": "Clicked to complete task: 'switch to 0.5x'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'airplane mode' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [348, 885]}], "status_update": "Clicked to complete task: 'airplane mode'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'login with wechat' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [583, 1264]}], "status_update": "Clicked to complete task: 'login with wechat'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'forwarding' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1068, 216]}], "status_update": "Clicked to complete task: 'forwarding'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'return previous page' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [107, 172]}], "status_update": "Clicked to complete task: 'return previous page'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'disagree the agreement' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [318, 2206]}], "status_update": "Clicked to complete task: 'disagree the agreement'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open clock at 3' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [906, 1094]}], "status_update": "Clicked to complete task: 'open clock at 3'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open account profile' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [532, 411]}], "status_update": "Clicked to complete task: 'open account profile'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open gmail' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [106, 547]}], "status_update": "Clicked to complete task: 'open gmail'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'power on' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [340, 1182]}], "status_update": "Clicked to complete task: 'power on'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'add a room' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1990, 276]}], "status_update": "Clicked to complete task: 'add a room'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'remove maps from the desktop' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [959, 809]}], "status_update": "Clicked to complete task: 'remove maps from the desktop'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'adjust the color' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [952, 2326]}], "status_update": "Clicked to complete task: 'adjust the color'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open a brush' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [447, 1492]}], "status_update": "Clicked to complete task: 'open a brush'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'open high resolution 50mp mode' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [326, 604]}], "status_update": "Clicked to complete task: 'open high resolution 50mp mode'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'search' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1009, 176]}], "status_update": "Clicked to complete task: 'search'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'options' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [971, 176]}], "status_update": "Clicked to complete task: 'options'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'done' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [538, 2027]}], "status_update": "Clicked to complete task: 'done'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'add a emoji' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [981, 1153]}], "status_update": "Clicked to complete task: 'add a emoji'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'filte unread feeds' in this screenshot from android using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [486, 538]}], "status_update": "Clicked to complete task: 'filte unread feeds'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'view last month cellular data' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [840, 1581]}], "status_update": "Clicked to complete task: 'view last month cellular data'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'check out jony j's album' in this screenshot from ios using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [582, 1040]}], "status_update": "Clicked to complete task: 'check out jony j's album'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'add a new one' in this screenshot from gitlab using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [1809, 46]}], "status_update": "Clicked to complete task: 'add a new one'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'search my projects' in this screenshot from gitlab using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [915, 143]}], "status_update": "Clicked to complete task: 'search my projects'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'sign in' in this screenshot from gitlab using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [2444, 102]}], "status_update": "Clicked to complete task: 'sign in'."}


[System] You are Tecky, a virtual employee that helps users automate computer workflows. Your job is to control the computer through click actions and mention their target in [x, y] coordinates.

[User] Complete the task 'create a blank project' in this screenshot from gitlab using a click input only. Return the output as a JSON with the 'actions' (with 'click' and coordinates) and a short 'status_update'.

[Assistant] {"actions": [{"action": "click", "target": [723, 548]}], "status_update": "Clicked to complete task: 'create a blank project'."}