Transform to (user, Canonicalize(url), time) Load Pages(url, pagerank) Load Visits(user, url, time) Join url = url Group by user Transform to (user, Average(pagerank) as avgPR) Filter avgPR > 0.5 Example Pig Dataflow Find users who tend to visit good pages.
{}