我通过sql和dataframe查询的结果不一致，老师帮忙看下吧，代码如下：

def topNStatistics(sparkSession: SparkSession, dataFrame: DataFrame, day: String) = {
    import sparkSession.implicits._
    //dataFrame.filter($"day" === day && $"category" === "video").groupBy($"id", $"day").count().sort($"count".desc).show()
    dataFrame.filter($"day" === day && $"category" === "video").groupBy($"id", $"day").agg(count($"id").as("times")).sort($"times".desc).show(5)
    dataFrame.createOrReplaceTempView("access")
    sparkSession.sql(s"select id,day,count(1) as times from access where day = '$day' and category = 'video' group by id, day sort by times desc" ).show(5)
}

结果如下：

+-------------------------------+--------+----+---------------+--------+----+-------+----+--------+
|url                            |category|id  |ip             |province|city|time   |flow|day     |
+-------------------------------+--------+----+---------------+--------+----+-------+----+--------+
|http://www.imooc.com/code/1852 |code    |1852|117.35.88.11   |陕西省     |西安市 |0:01:02|2345|20161110|
|http://www.imooc.com/code/2053 |code    |2053|211.162.33.31  |福建省     |厦门市 |0:01:02|331 |20161110|
|http://www.imooc.com/code/3500 |code    |3500|116.22.196.70  |广东省     |广州市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/547  |code    |547 |119.130.229.90 |广东省     |广州市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/2053 |code    |2053|211.162.33.31  |福建省     |厦门市 |0:01:02|2954|20161110|
|http://www.imooc.com/video/8701|video   |8701|106.39.41.166  |北京市     |北京市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/75   |code    |75  |125.119.9.35   |浙江省     |杭州市 |0:01:02|2152|20161110|
|http://www.imooc.com/video/9819|video   |9819|125.122.216.102|浙江省     |杭州市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/75   |code    |75  |125.119.9.35   |浙江省     |杭州市 |0:01:02|358 |20161110|
|http://www.imooc.com/video/6335|video   |6335|116.231.219.242|上海市     |上海市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/939  |code    |939 |120.85.249.51  |广东省     |广州市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/1852 |code    |1852|117.35.88.11   |陕西省     |西安市 |0:01:02|2640|20161110|
|http://www.imooc.com/video/7629|video   |7629|61.136.143.62  |湖北省     |宜昌市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/2053 |code    |2053|211.162.33.31  |福建省     |厦门市 |0:01:02|2202|20161110|
|http://www.imooc.com/video/3237|video   |3237|39.186.247.142 |浙江省     |杭州市 |0:01:02|2957|20161110|
|http://www.imooc.com/code/75   |code    |75  |125.119.9.35   |浙江省     |杭州市 |0:01:02|66  |20161110|
|http://www.imooc.com/code/5515 |code    |5515|113.100.63.27  |广东省     |清远市 |0:01:02|54  |20161110|
|http://www.imooc.com/code/3036 |code    |3036|171.43.210.54  |湖北省     |武汉市 |0:01:02|67  |20161110|
|http://www.imooc.com/code/1852 |code    |1852|117.35.88.11   |陕西省     |西安市 |0:01:02|996 |20161110|
|http://www.imooc.com/video/7053|video   |7053|59.42.206.247  |广东省     |广州市 |0:01:02|54  |20161110|
+-------------------------------+--------+----+---------------+--------+----+-------+----+--------+
only showing top 20 rows

root
 |-- url: string (nullable = true)
 |-- category: string (nullable = true)
 |-- id: long (nullable = true)
 |-- ip: string (nullable = true)
 |-- province: string (nullable = true)
 |-- city: string (nullable = true)
 |-- time: string (nullable = true)
 |-- flow: long (nullable = true)
 |-- day: integer (nullable = true)

+----+--------+-----+
|  id|     day|times|
+----+--------+-----+
|1459|20161110| 2159|
|6701|20161110| 1426|
|1803|20161110| 1381|
|1412|20161110| 1226|
|3520|20161110| 1186|
+----+--------+-----+
only showing top 5 rows

+-----+--------+-----+
|   id|     day|times|
+-----+--------+-----+
|12302|20161110|  861|
| 1741|20161110|  558|
|  243|20161110|  295|
| 6850|20161110|  200|
| 6841|20161110|  117|
+-----+--------+-----+
only showing top 5 rows

耗时：16秒

数据是用的课程中提供的5G的数据文件，然后从中取出前1.2G左右测试的