ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

BenchmarkDotNet性能测试

2022-02-07 20:32:25  阅读:201  来源: 互联网

标签:set get 性能 us BenchmarkDotNet 测试 ns public op


 

 

  BenchmarkDotNet是一款开源的性能测试工具,使用方式非常简单,特别是对实现同一功能的两种方式,犹豫不决时,可以使用它进行个对比。

  比如我们比较ADO.NET方式查询数据库表,和用Dapper方式获取数据为表,只需要在两个方法上增加 [Benchmark]就可以了,然后调用var summary = BenchmarkRunner.Run<Cycle>();就实现了性能测试。

using System;
using System.ComponentModel;
using System.Data;
using System.Data.SqlClient;
using System.Security.Cryptography;
using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;
using Dapper;

namespace MyBenchmarks
{
    public class Product
    {
        public string Name { get; set; }
        public string ProductNumber { get; set; }
        public bool MakeFlag { get; set; }
        public bool FinishedGoodsFlag { get; set; }
        public string Color { get; set; }
        public short SafetyStockLevel { get; set; }
        public short ReorderPoint { get; set; }
        public decimal StandardCost { get; set; }
        public decimal ListPrice { get; set; }
        public string Size { get; set; }
        public string SizeUnitMeasureCode { get; set; }
        public string WeightUnitMeasureCode { get; set; }
        public double Weight { get; set; }
        public int DaysToManufacture { get; set; }
        public string ProductLine { get; set; }
        public string Class { get; set; }
        public string Style { get; set; }
        public int ProductSubcategoryID { get; set; }
        public int ProductModelID { get; set; }
        public DateTime SellStartDate { get; set; }
        public DateTime SellEndDate { get; set; }
        public DateTime DiscontinuedDate { get; set; }
        public Guid rowguid { get; set; }
        public DateTime ModifiedDate { get; set; }


    }
    public class Cycle
    {

        [Benchmark]
        public void DapperTest()
        {
            var conn = new SqlConnection("Data Source=.;Initial Catalog=AdventureWorks2016;Persist Security Info=True;User ID=sa;password=sa;");
            var table = conn.Query<Product>("select top 100 * from production.product");
        }
        [Benchmark]
        public void CommandTest()
        {
            var conn = "Data Source=.;Initial Catalog=AdventureWorks2016;Persist Security Info=True;User ID=sa;password=sa;";
            var sql = "select top 100 * from production.product";
            var dapp = new SqlDataAdapter(sql, conn);
            var table = new DataTable();
            dapp.Fill(table);
        }
    }

    public class Program
    {
        public static void Main(string[] args)
        {
            var summary = BenchmarkRunner.Run<Cycle>();
        }
    }
}

  运行一下看一下结果,为了减少篇幅,删除了一些结果,从结果看出,为了得到较为客观的性能测试结果,BenchmarkDotNet还是做了很多工作的:

  OverheadJitting,WorkloadJitting,WorkloadPilot,OverheadWarmup,OverheadActual,WorkloadWarmup,WorkloadActual,WorkloadResult。

  并且通过最后的一个表格,清楚的给出了结果。同时还给出了Warnings ,以供参考。

// Validating benchmarks:
// ***** BenchmarkRunner: Start   *****
// ***** Found 2 benchmark(s) in total *****
// ***** Building 1 exe(s) in Parallel: Start   *****
// start dotnet restore  /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in C:\MyFile\Source\Repos\Asp.NetCoreExperiment\Asp.NetCoreExperiment\BenchmarkDotNet\Demo01\bin\Release\net6.0\03bf0209-ac26-4de1-b763-4ba03e46cf4d
// command took 2.83s and exited with 0
// start dotnet build -c Release  --no-restore /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in C:\MyFile\Source\Repos\Asp.NetCoreExperiment\Asp.NetCoreExperiment\BenchmarkDotNet\Demo01\bin\Release\net6.0\03bf0209-ac26-4de1-b763-4ba03e46cf4d
// command took 4.29s and exited with 0
// ***** Done, took 00:00:07 (7.52 sec)   *****
// Found 2 benchmarks:
//   Cycle.DapperTest: DefaultJob
//   Cycle.CommandTest: DefaultJob

// **************************
// Benchmark: Cycle.DapperTest: DefaultJob
// *** Execute ***
// Launch: 1 / 1
// Execute: dotnet "03bf0209-ac26-4de1-b763-4ba03e46cf4d.dll" --benchmarkName "MyBenchmarks.Cycle.DapperTest" --job "Default" --benchmarkId 0 in C:\MyFile\Source\Repos\Asp.NetCoreExperiment\Asp.NetCoreExperiment\BenchmarkDotNet\Demo01\bin\Release\net6.0\03bf0209-ac26-4de1-b763-4ba03e46cf4d\bin\Release\net6.0
// BeforeAnythingElse

// Benchmark Process Environment Information:
// Runtime=.NET 6.0.0 (6.0.21.25307), X64 RyuJIT
// GC=Concurrent Workstation
// Job: DefaultJob

OverheadJitting  1: 1 op, 229700.00 ns, 229.7000 us/op
WorkloadJitting  1: 1 op, 410021000.00 ns, 410.0210 ms/op

WorkloadWarmup   1: 1 op, 4581600.00 ns, 4.5816 ms/op
WorkloadWarmup   2: 1 op, 746500.00 ns, 746.5000 us/op
WorkloadWarmup   3: 1 op, 830000.00 ns, 830.0000 us/op
WorkloadWarmup   4: 1 op, 822900.00 ns, 822.9000 us/op
WorkloadWarmup   5: 1 op, 741800.00 ns, 741.8000 us/op
WorkloadWarmup   6: 1 op, 746900.00 ns, 746.9000 us/op
WorkloadWarmup   7: 1 op, 826300.00 ns, 826.3000 us/op
WorkloadWarmup   8: 1 op, 698300.00 ns, 698.3000 us/op

// BeforeActualRun
WorkloadActual   1: 1 op, 755100.00 ns, 755.1000 us/op
……
WorkloadActual  100: 1 op, 712700.00 ns, 712.7000 us/op

// AfterActualRun
WorkloadResult   1: 1 op, 755100.00 ns, 755.1000 us/op
……
WorkloadResult  95: 1 op, 712700.00 ns, 712.7000 us/op

// AfterAll
// Benchmark Process 26724 has exited with code 0

Mean = 753.054 us, StdErr = 11.687 us (1.55%), N = 95, StdDev = 113.909 us
Min = 578.400 us, Q1 = 668.600 us, Median = 734.900 us, Q3 = 798.800 us, Max = 1,052.600 us
IQR = 130.200 us, LowerFence = 473.300 us, UpperFence = 994.100 us
ConfidenceInterval = [713.353 us; 792.754 us] (CI 99.9%), Margin = 39.701 us (5.27% of Mean)
Skewness = 0.87, Kurtosis = 2.93, MValue = 3.63

// **************************
// Benchmark: Cycle.CommandTest: DefaultJob
// *** Execute ***
// Launch: 1 / 1
// Execute: dotnet "03bf0209-ac26-4de1-b763-4ba03e46cf4d.dll" --benchmarkName "MyBenchmarks.Cycle.CommandTest" --job "Default" --benchmarkId 1 in C:\MyFile\Source\Repos\Asp.NetCoreExperiment\Asp.NetCoreExperiment\BenchmarkDotNet\Demo01\bin\Release\net6.0\03bf0209-ac26-4de1-b763-4ba03e46cf4d\bin\Release\net6.0
// BeforeAnythingElse

// Benchmark Process Environment Information:
// Runtime=.NET 6.0.0 (6.0.21.25307), X64 RyuJIT
// GC=Concurrent Workstation
// Job: DefaultJob

OverheadJitting  1: 1 op, 215400.00 ns, 215.4000 us/op
WorkloadJitting  1: 1 op, 339247500.00 ns, 339.2475 ms/op

WorkloadWarmup   1: 1 op, 3680100.00 ns, 3.6801 ms/op
WorkloadWarmup   2: 1 op, 943000.00 ns, 943.0000 us/op
WorkloadWarmup   3: 1 op, 875200.00 ns, 875.2000 us/op
WorkloadWarmup   4: 1 op, 982500.00 ns, 982.5000 us/op
WorkloadWarmup   5: 1 op, 956900.00 ns, 956.9000 us/op
WorkloadWarmup   6: 1 op, 1030800.00 ns, 1.0308 ms/op
WorkloadWarmup   7: 1 op, 1170900.00 ns, 1.1709 ms/op
WorkloadWarmup   8: 1 op, 1169400.00 ns, 1.1694 ms/op

// BeforeActualRun
WorkloadActual   1: 1 op, 975400.00 ns, 975.4000 us/op
……
WorkloadActual  100: 1 op, 897400.00 ns, 897.4000 us/op

// AfterActualRun
WorkloadResult   1: 1 op, 975400.00 ns, 975.4000 us/op
……
WorkloadResult  91: 1 op, 897400.00 ns, 897.4000 us/op

// AfterAll
// Benchmark Process 17300 has exited with code 0

Mean = 951.263 us, StdErr = 13.676 us (1.44%), N = 91, StdDev = 130.465 us
Min = 759.300 us, Q1 = 864.000 us, Median = 912.900 us, Q3 = 1,004.600 us, Max = 1,316.000 us
IQR = 140.600 us, LowerFence = 653.100 us, UpperFence = 1,215.500 us
ConfidenceInterval = [904.736 us; 997.789 us] (CI 99.9%), Margin = 46.526 us (4.89% of Mean)
Skewness = 0.95, Kurtosis = 3.05, MValue = 2.44

// ***** BenchmarkRunner: Finish  *****

// * Export *
  BenchmarkDotNet.Artifacts\results\MyBenchmarks.Cycle-report.csv
  BenchmarkDotNet.Artifacts\results\MyBenchmarks.Cycle-report-github.md
  BenchmarkDotNet.Artifacts\results\MyBenchmarks.Cycle-report.html

// * Detailed results *
Cycle.DapperTest: DefaultJob
Runtime = .NET 6.0.0 (6.0.21.25307), X64 RyuJIT; GC = Concurrent Workstation
Mean = 753.054 us, StdErr = 11.687 us (1.55%), N = 95, StdDev = 113.909 us
Min = 578.400 us, Q1 = 668.600 us, Median = 734.900 us, Q3 = 798.800 us, Max = 1,052.600 us
IQR = 130.200 us, LowerFence = 473.300 us, UpperFence = 994.100 us
ConfidenceInterval = [713.353 us; 792.754 us] (CI 99.9%), Margin = 39.701 us (5.27% of Mean)
Skewness = 0.87, Kurtosis = 2.93, MValue = 3.63
-------------------- Histogram --------------------
[  545.635 us ;   582.035 us) | @
[  582.035 us ;   650.935 us) | @@@@@@@@@@@@@@@
[  650.935 us ;   726.135 us) | @@@@@@@@@@@@@@@@@@@@@@@@@@@
[  726.135 us ;   791.665 us) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@
[  791.665 us ;   852.365 us) | @@@@@@@@
[  852.365 us ;   924.365 us) | @@@
[  924.365 us ; 1,009.685 us) | @@@@@@@@@@@
[1,009.685 us ; 1,085.365 us) | @@
---------------------------------------------------

Cycle.CommandTest: DefaultJob
Runtime = .NET 6.0.0 (6.0.21.25307), X64 RyuJIT; GC = Concurrent Workstation
Mean = 951.263 us, StdErr = 13.676 us (1.44%), N = 91, StdDev = 130.465 us
Min = 759.300 us, Q1 = 864.000 us, Median = 912.900 us, Q3 = 1,004.600 us, Max = 1,316.000 us
IQR = 140.600 us, LowerFence = 653.100 us, UpperFence = 1,215.500 us
ConfidenceInterval = [904.736 us; 997.789 us] (CI 99.9%), Margin = 46.526 us (4.89% of Mean)
Skewness = 0.95, Kurtosis = 3.05, MValue = 2.44
-------------------- Histogram --------------------
[  721.230 us ;   780.280 us) | @@
[  780.280 us ;   860.730 us) | @@@@@@@@@@@@@@@@@@@@
[  860.730 us ;   936.870 us) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[  936.870 us ; 1,020.120 us) | @@@@@@@@@@@@@@@@
[1,020.120 us ; 1,080.630 us) | @@@@@
[1,080.630 us ; 1,170.980 us) | @@@@@@@
[1,170.980 us ; 1,247.120 us) | @@@@@@@@
[1,247.120 us ; 1,277.930 us) |
[1,277.930 us ; 1,354.070 us) | @
---------------------------------------------------

// * Summary *

BenchmarkDotNet=v0.13.0, OS=Windows 10.0.19043.1052 (21H1/May2021Update)
Intel Core i7-7700HQ CPU 2.80GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET SDK=6.0.100-preview.4.21255.9
  [Host]     : .NET 6.0.0 (6.0.21.25307), X64 RyuJIT  [AttachedDebugger]
  DefaultJob : .NET 6.0.0 (6.0.21.25307), X64 RyuJIT


|      Method |     Mean |    Error |   StdDev |   Median |
|------------ |---------:|---------:|---------:|---------:|
|  DapperTest | 753.1 us | 39.70 us | 113.9 us | 734.9 us |
| CommandTest | 951.3 us | 46.53 us | 130.5 us | 912.9 us |

// * Warnings *
MultimodalDistribution
  Cycle.DapperTest: Default -> It seems that the distribution is bimodal (mValue = 3.63)
Environment
  Summary -> Benchmark was executed with attached debugger
MinIterationTime
  Cycle.DapperTest: Default  -> The minimum observed iteration time is 578.4000 us which is very small. It's recommended to increase it to at least 100.0000 ms using more operations.
  Cycle.CommandTest: Default -> The minimum observed iteration time is 759.3000 us which is very small. It's recommended to increase it to at least 100.0000 ms using more operations.

// * Hints *
Outliers
  Cycle.DapperTest: Default  -> 5 outliers were removed (1.06 ms..2.17 ms)
  Cycle.CommandTest: Default -> 9 outliers were removed (1.37 ms..2.51 ms)

// * Legends *
  Mean   : Arithmetic mean of all measurements
  Error  : Half of 99.9% confidence interval
  StdDev : Standard deviation of all measurements
  Median : Value separating the higher half of all measurements (50th percentile)
  1 us   : 1 Microsecond (0.000001 sec)

// ***** BenchmarkRunner: End *****
// ** Remained 0 benchmark(s) to run **
Run time: 00:00:03 (3.12 sec), executed benchmarks: 2

Global total time: 00:00:10 (10.65 sec), executed benchmarks: 2
// * Artifacts cleanup *

 

  想要更快更方便的了解相关知识,可以关注微信公众号   

 

 

标签:set,get,性能,us,BenchmarkDotNet,测试,ns,public,op
来源: https://www.cnblogs.com/axzxs2001/p/15869061.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有