machine-learning/03-Training and AutoML.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "# Training and AutoML"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## In this Notebook, you will learn\n",
        "- What does __Training__ mean?\n",
        "- Introduction to trainers,  some of their differences, and how to decide which one to use.\n",
        "- How hyper-parameters impact training performance.\n",
        "- How to use AutoML to simplify your training process."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## What does __Training__ mean.\n",
        "Before diving into code, let's first talk a little about what does \"train a model\" actually mean. \n",
        "\n",
        "In ML.Net, \"train a model\" usually means call `model.Fit(X)` in ML.Net, where `X` is an `IDataView` which includes both feature and label. So what happen when you call `Fit`? Generally speaking, `Fit` updates parameters in the trainer so it can predict label that is **close** to the actual label in `X`, or in another word, to decrease the distance between predicted and actual label.\n",
        "\n",
        "In machine learning, the difference or distance between predicted and actual label is usually called **loss** and you use different loss measures based on the task. For classification softmax is a common loss measure. For regression, Root Mean Squared Error (RMSE) is a common loss measure. In general though, they are all metrics to quantify the distance between the predicted and actual label. In most of cases, a **lower loss means a better model**. For more information, see the [ML.NET evaluation metrics guide](https://docs.microsoft.com/dotnet/machine-learning/resources/metrics).\n",
        "\n",
        "So what `Fit` does is to apply an algorithm to your data to identify patterns and adjust parameters in that algorithm to lowers the loss. When you train a model, you want to decrease its loss to make the prediction of that model closer to the actual label."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Trainers in ML.Net\n",
        "ML.NET provides a variety of trainers. You can find most of them under the [StandardTrainersCatalog](https://docs.microsoft.com/dotnet/api/microsoft.ml.standardtrainerscatalog?view=ml-dotnet). Examples of trainers include linear trainers like `SDCA`, `Lbfgs`, `LinearSvm` and tree-based non-linear trainers like `FastTree`, `RandomForest` and `LightGbm`. Generally, each trainer's capability is different. Non-linear models sometimes have better training performance (lower loss) than linear ones, but it doesn't always mean they are always the better choice. Picking the right trainer to build the best model for your data requires many attempts of trial and error.\n",
        "\n",
        "### Overfitting and Underfitting\n",
        "Overfitting and underfitting are the two most common problems you encounter when training a model. Underfitting means the selected trainer is not capable enough to fit training dataset and usually result in a high loss during training and low score/metric on test dataset. To resolve this you need to either select a more powerful model or perform more feature engineering. Overfitting is the opposite, which happens when model learns the training data too well. This usually results in low loss metric during training but high loss on test dataset.\n",
        "\n",
        "A good analogy for these concepts is studying for an exam. Let's say you knew the questions and answers ahead of time. After studying, you take the test and get a perfect score. Great news! However, when you're given the exam again with the questions rearranged and with slightly different wording you get a lower score. That suggests you memorized the answers and didn't actually learn the concepts you were being tested on. This is an example of overfitting. Underfitting is the opposite where the study materials you were given don't accurately represent what you're evaluated on for the exam. As a result, you resort to guessing the answers since you don't have enough knowledge to answer correctly.\n",
        "\n",
        "### Difference in parameter and hyper-parameter\n",
        "In the nutshell, parameters are internal to a trainer, and is updated based on training dataset during training(`Fit`) process. While hyper-parameters are external to a trainer and control training process. For example, in `LightGbm`, `LearningRate` is a hyper-parameter which you can designate when creating and it controls the updating steps for the tree nodes weight during training. And tree nodes weight is parameter which is adjusted during `Fit` process.\n",
        "\n",
        "### Hyper-parameter optimization\n",
        "Choosing the right trainer impacts your final training performance. Choosing the right hyper-parameters also has a huge impact over the final training performance, especially for tree-base trainers. Hyper-parameters are important because it controls how parameter being updated. For example, larger `numberOfLeaves` in `LightGbm` produces a larger model and usually enables it to fit on a more complex dataset, but it might have countereffect on small dataset and cause **overfitting**. Conversely, if the dataset is complex but you set a small `numberOfLeaves`, it might impair `LightGbm`'s ability on fitting that dataset and cause **underfit**.\n",
        "\n",
        "The process of finding the best configuration for your trainer is known as hyper-parameter optimization (HPO). Like the process of choosing your trainer it involves a lot of trial and error. The built-in Automated ML (AutoML) capabilities in ML.NET simplify the HPO process.\n",
        "\n",
        "In the next section, we will go through two examples. The first example trains a regression model on a linear dataset using both linear and more advanced non-linear trainers to highlight the importance of selecting the right trainer. The second example trains a regression model on a non-linear dataset using `LightGbm` with different hyper-parameters to show the importance of hyper-parameter optimization"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Example 1: Linear regression\n",
        "In the below section, we are going to show the difference of trainers via a linear regression task. First, we fit the linear dataset with the linear trainer, `SDCA`. Then we git the linear dataset with `LightGbm`, a tree-base non-linear trainer. Their performance is evaluated against a test dataset. The code below:\n",
        "- Creates a linear dataset and splits it into train/test sets\n",
        "- Create training pipelines using `SDCA` and `LightGbm`\n",
        "- Trains both `SDCA` and `LightGbm` on the linear training set, and evaluates them on the test set."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<div><div><strong>Restore sources</strong><ul><li><span>https://pkgs.dev.azure.com/dnceng/public/_packaging/MachineLearning/nuget/v3/index.json</span></li></ul></div><div></div><div><strong>Installed Packages</strong><ul><li><span>Microsoft.Data.Analysis, 0.20.0-preview.22356.1</span></li><li><span>Microsoft.ML.AutoML, 0.20.0-preview.22356.1</span></li><li><span>Plotly.NET.CSharp, 0.0.1</span></li><li><span>Plotly.NET.Interactive, 3.0.2</span></li></ul></div></div>"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        },
        {
          "data": {
            "text/markdown": [
              "Loading extensions from `Microsoft.ML.AutoML.Interactive.dll`"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        },
        {
          "data": {
            "text/markdown": [
              "Loading extensions from `Microsoft.Data.Analysis.Interactive.dll`"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        },
        {
          "data": {
            "text/markdown": [
              "Loading extensions from `Plotly.NET.Interactive.dll`"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "// using nightly-build\n",
        "#i \"nuget:https://pkgs.dev.azure.com/dnceng/public/_packaging/MachineLearning/nuget/v3/index.json\"\n",
        "#r \"nuget: Plotly.NET.Interactive, 3.0.2\"\n",
        "#r \"nuget: Plotly.NET.CSharp, 0.0.1\"\n",
        "#r \"nuget: Microsoft.ML.AutoML, 0.20.0-preview.22356.1\"\n",
        "#r \"nuget: Microsoft.Data.Analysis, 0.20.0-preview.22356.1\""
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [],
      "source": [
        "// Import usings.\n",
        "using Microsoft.Data.Analysis;\n",
        "using System;\n",
        "using System.IO;\n",
        "using Microsoft.ML;\n",
        "using Microsoft.ML.AutoML;\n",
        "using Microsoft.ML.Data;"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Create linear dataset\n",
        "The code below creates a linear dataset with a random residual. The dataset is loaded into train and test set."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<table id=\"table_637927892555216357\"><thead><tr><th><i>index</i></th><th>X</th><th>y</th></tr></thead><tbody><tr><td><i><div class=\"dni-plaintext\">0</div></i></td><td><div class=\"dni-plaintext\">-1000</div></td><td><div class=\"dni-plaintext\">-99997.734</div></td></tr><tr><td><i><div class=\"dni-plaintext\">1</div></i></td><td><div class=\"dni-plaintext\">-999.9</div></td><td><div class=\"dni-plaintext\">-99986.83</div></td></tr><tr><td><i><div class=\"dni-plaintext\">2</div></i></td><td><div class=\"dni-plaintext\">-999.8</div></td><td><div class=\"dni-plaintext\">-99977.32</div></td></tr><tr><td><i><div class=\"dni-plaintext\">3</div></i></td><td><div class=\"dni-plaintext\">-999.7</div></td><td><div class=\"dni-plaintext\">-99969.42</div></td></tr><tr><td><i><div class=\"dni-plaintext\">4</div></i></td><td><div class=\"dni-plaintext\">-999.60004</div></td><td><div class=\"dni-plaintext\">-99962.94</div></td></tr><tr><td><i><div class=\"dni-plaintext\">5</div></i></td><td><div class=\"dni-plaintext\">-999.5</div></td><td><div class=\"dni-plaintext\">-99949.414</div></td></tr><tr><td><i><div class=\"dni-plaintext\">6</div></i></td><td><div class=\"dni-plaintext\">-999.4</div></td><td><div class=\"dni-plaintext\">-99935.94</div></td></tr><tr><td><i><div class=\"dni-plaintext\">7</div></i></td><td><div class=\"dni-plaintext\">-999.3</div></td><td><div class=\"dni-plaintext\">-99930.58</div></td></tr><tr><td><i><div class=\"dni-plaintext\">8</div></i></td><td><div class=\"dni-plaintext\">-999.2</div></td><td><div class=\"dni-plaintext\">-99915.23</div></td></tr><tr><td><i><div class=\"dni-plaintext\">9</div></i></td><td><div class=\"dni-plaintext\">-999.10004</div></td><td><div class=\"dni-plaintext\">-99912.266</div></td></tr></tbody></table>"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "var rand = new Random(0);\n",
        "var context =new MLContext(seed: 1);\n",
        "var x = Enumerable.Range(-10000, 10000).Select(_x => _x * 0.1f).ToArray();\n",
        "var y = x.Select(_x => 100 * _x + (rand.NextSingle() - 0.5f) * 10).ToArray();\n",
        "var df = new DataFrame();\n",
        "df[\"X\"] = DataFrameColumn.Create(\"X\", x);\n",
        "df[\"y\"] = DataFrameColumn.Create(\"y\", y);\n",
        "var trainTestSplit = context.Data.TrainTestSplit(df);\n",
        "df.Head(10)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Construct pipeline\n",
        "The code below shows how to construct training pipelines for both `SDCA` and `LightGbm`. The `Concatenate` transformer is required to convert a `single` column into `Vector<single>` type, which is the expected feature type for both `SDCA` and `LightGbm` regressor."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [],
      "source": [
        "var sdcaPipeline = context.Transforms.Concatenate(\"Features\", \"X\")\n",
        "                            .Append(context.Regression.Trainers.Sdca(\"y\"));"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [],
      "source": [
        "var lgbmPipeline = context.Transforms.Concatenate(\"Features\", \"X\")\n",
        "                            .Append(context.Regression.Trainers.LightGbm(\"y\"));"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Train and evaluate model\n",
        "The code below first trains `sdcaPipeline` and `lgbmPipeline` which are created above, then evaluate their performance on test dataset by calculating `Root Mean Square Error` between predicted and actual value. `SDCA` has better performance with a significantly lower `Root Mean Square Error` compared to `LightGbm` even though it's a simpler linear model. This is because the training dataset is also linear, so `SDCA` can fit the dataset better than `LightGbm`."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "sdca rmse on trainset: 2.9576339604324984, lgbm rmse on trainset: 117.9591141671402\n",
            "sdca rmse on testset: 2.989504150889505, lgbm rmse on testset: 119.860254032606"
          ]
        }
      ],
      "source": [
        "var sdcaModel = sdcaPipeline.Fit(trainTestSplit.TrainSet);\n",
        "var lgbmModel = lgbmPipeline.Fit(trainTestSplit.TrainSet);\n",
        "\n",
        "// evaluate on train set\n",
        "var sdcaTrainEval = sdcaModel.Transform(trainTestSplit.TrainSet);\n",
        "var sdcaTrainMetric = context.Regression.Evaluate(sdcaTrainEval, \"y\");\n",
        "\n",
        "var lgbmTrainEval = lgbmModel.Transform(trainTestSplit.TrainSet);\n",
        "var lgbmTrainMetric = context.Regression.Evaluate(lgbmTrainEval, \"y\");\n",
        "\n",
        "Console.WriteLine($\"sdca rmse on trainset: {sdcaTrainMetric.RootMeanSquaredError}, lgbm rmse on trainset: {lgbmTrainMetric.RootMeanSquaredError}\");\n",
        "\n",
        "// evaluate on test set\n",
        "var sdcaTestEval = sdcaModel.Transform(trainTestSplit.TestSet);\n",
        "var sdcaTestMetric = context.Regression.Evaluate(sdcaTestEval, \"y\");\n",
        "\n",
        "var lgbmTestEval = lgbmModel.Transform(trainTestSplit.TestSet);\n",
        "var lgbmTestMetric = context.Regression.Evaluate(lgbmTestEval, \"y\");\n",
        "Console.WriteLine($\"sdca rmse on testset: {sdcaTestMetric.RootMeanSquaredError}, lgbm rmse on testset: {lgbmTestMetric.RootMeanSquaredError}\");"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Example 2: Non-linear regression on LightGbm.\n",
        "This example shows the importance of hyper-parameter optimization. First we create a non-linear dataset and two pipelines. One pipeline has `LightGbm` with `numberOfLeaves` set to `10`, the other's set to `1000`. Both pipelines are trained with the same training dataset and their training performance is evaluated on the same test dataset."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Create non-linear dataset\n",
        "The code below creates a non-linear dataset with a random residual. The dataset is loaded into train and test set"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<table id=\"table_637927892744709146\"><thead><tr><th><i>index</i></th><th>X</th><th>y</th></tr></thead><tbody><tr><td><i><div class=\"dni-plaintext\">0</div></i></td><td><div class=\"dni-plaintext\">-1000</div></td><td><div class=\"dni-plaintext\">100000000</div></td></tr><tr><td><i><div class=\"dni-plaintext\">1</div></i></td><td><div class=\"dni-plaintext\">-999.9</div></td><td><div class=\"dni-plaintext\">99980000</div></td></tr><tr><td><i><div class=\"dni-plaintext\">2</div></i></td><td><div class=\"dni-plaintext\">-999.8</div></td><td><div class=\"dni-plaintext\">99960000</div></td></tr><tr><td><i><div class=\"dni-plaintext\">3</div></i></td><td><div class=\"dni-plaintext\">-999.7</div></td><td><div class=\"dni-plaintext\">99940010</div></td></tr><tr><td><i><div class=\"dni-plaintext\">4</div></i></td><td><div class=\"dni-plaintext\">-999.60004</div></td><td><div class=\"dni-plaintext\">99920020</div></td></tr><tr><td><i><div class=\"dni-plaintext\">5</div></i></td><td><div class=\"dni-plaintext\">-999.5</div></td><td><div class=\"dni-plaintext\">99900024</div></td></tr><tr><td><i><div class=\"dni-plaintext\">6</div></i></td><td><div class=\"dni-plaintext\">-999.4</div></td><td><div class=\"dni-plaintext\">99880050</div></td></tr><tr><td><i><div class=\"dni-plaintext\">7</div></i></td><td><div class=\"dni-plaintext\">-999.3</div></td><td><div class=\"dni-plaintext\">99860050</div></td></tr><tr><td><i><div class=\"dni-plaintext\">8</div></i></td><td><div class=\"dni-plaintext\">-999.2</div></td><td><div class=\"dni-plaintext\">99840070</div></td></tr><tr><td><i><div class=\"dni-plaintext\">9</div></i></td><td><div class=\"dni-plaintext\">-999.10004</div></td><td><div class=\"dni-plaintext\">99820090</div></td></tr></tbody></table>"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "var rand = new Random(0);\n",
        "var context =new MLContext(seed: 1);\n",
        "var x = Enumerable.Range(-10000, 10000).Select(_x => _x * 0.1f).ToArray();\n",
        "var y = x.Select(_x => 100 * _x * _x + (rand.NextSingle() - 0.5f) * 10).ToArray();\n",
        "var df = new DataFrame();\n",
        "df[\"X\"] = DataFrameColumn.Create(\"X\", x);\n",
        "df[\"y\"] = DataFrameColumn.Create(\"y\", y);\n",
        "var trainTestSplit = context.Data.TrainTestSplit(df);\n",
        "df.Head(10)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Construct pipeline\n",
        "The code below shows how to construct training pipelines for `LightGbm` with different hyper-parameters. The `Concatenate` transformer is required because it converts a `single` column into `Vector<single>` type, which is the expected feature type for the `LightGbm` trainer."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [],
      "source": [
        "var smallLgbmPipeline = context.Transforms.Concatenate(\"Features\", \"X\")\n",
        "                            .Append(context.Regression.Trainers.LightGbm(\"y\", numberOfLeaves: 10));"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [],
      "source": [
        "var largeLgbmPipeline = context.Transforms.Concatenate(\"Features\", \"X\")\n",
        "                            .Append(context.Regression.Trainers.LightGbm(\"y\", numberOfLeaves: 1000));"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Train and evaluate model\n",
        "The code below first trains `smallLgbmPipeline` and `largeLgbmPipeline` which are created above, then evaluates their performance on the test dataset by calculating the `Root Mean Square Error` between predicted and actual value. The model created by `largeLgbmPipeline` has better performance with a lower RMSE."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "small lgbm rmse on testset: 173938.52924678137, large lgbm rmse on testset: 132927.2510939994"
          ]
        }
      ],
      "source": [
        "var smallLgbmModel = smallLgbmPipeline.Fit(trainTestSplit.TrainSet);\n",
        "var largeLgbmModel = largeLgbmPipeline.Fit(trainTestSplit.TrainSet);\n",
        "\n",
        "// evaluate on test set\n",
        "var smallTestEval = smallLgbmModel.Transform(trainTestSplit.TrainSet);\n",
        "var smallLgbmMetric = context.Regression.Evaluate(smallTestEval, \"y\");\n",
        "\n",
        "var largeLgbmEval = largeLgbmModel.Transform(trainTestSplit.TrainSet);\n",
        "var largeLgbmMetric = context.Regression.Evaluate(largeLgbmEval, \"y\");\n",
        "\n",
        "Console.WriteLine($\"small lgbm rmse on testset: {smallLgbmMetric.RootMeanSquaredError}, large lgbm rmse on testset: {largeLgbmMetric.RootMeanSquaredError}\");"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Use AutoML to simplify trainer selection and hyper-parameter optimization.\n",
        "Trainer selection and Hyper-parameter optimization is an important process with lots of trial and error. This process can be automated and simplified using the built-in `AutoMLExperiment`. `AutoMLExperiment` applies the latest research from Microsoft Research to conduct a swift, accurate and thorough hyper-parameter optimization given a limited time budget.\n",
        "\n",
        "The code below shows how to use `AutoMLExperiment` for finding the best trainer along with its best hyper parrameter on the non-linear dataset used in Example 2. Firstly, a `SweepableEstimatorPipeline` is created via `context.Auto().Regression(\"y\")`, which returns the most popular regressors along with their default search space in ML.Net. Then an `AutoMLExperiment` is created. It uses `RootMeanSquaredError` as optimization metric and train-test validation to evaluate trial score, and uses `NotebookMonitor` to present training process. Once the training is completed, it returns the best trial as result."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<div><h3>Best Trial</h3><p>Id: 122</p><p>Trainer: FastTreeRegression</p><p>Parameters: {\r\n",
              "  &quot;0&quot;: {},\r\n",
              "  &quot;1&quot;: {\r\n",
              "    &quot;NumberOfLeaves&quot;: 1322,\r\n",
              "    &quot;MinimumExampleCountPerLeaf&quot;: 6,\r\n",
              "    &quot;NumberOfTrees&quot;: 4,\r\n",
              "    &quot;MaximumBinCountPerFeature&quot;: 1012,\r\n",
              "    &quot;FeatureFraction&quot;: 0.8985547439094765,\r\n",
              "    &quot;LearningRate&quot;: 0.9999997766729865,\r\n",
              "    &quot;LabelColumnName&quot;: &quot;y&quot;,\r\n",
              "    &quot;FeatureColumnName&quot;: &quot;Features&quot;\r\n",
              "  }\r\n",
              "}</p><h3>Active Trial</h3><p>Id: 129</p><p>Trainer: LightGbmRegression</p><p>Parameters: {\r\n",
              "  &quot;0&quot;: {},\r\n",
              "  &quot;1&quot;: {\r\n",
              "    &quot;NumberOfLeaves&quot;: 57,\r\n",
              "    &quot;MinimumExampleCountPerLeaf&quot;: 20,\r\n",
              "    &quot;LearningRate&quot;: 0.045052945604449335,\r\n",
              "    &quot;NumberOfTrees&quot;: 1042,\r\n",
              "    &quot;SubsampleFraction&quot;: 1.1337869487179775E-05,\r\n",
              "    &quot;MaximumBinCountPerFeature&quot;: 762,\r\n",
              "    &quot;FeatureFraction&quot;: 0.638772340228462,\r\n",
              "    &quot;L1Regularization&quot;: 7.196221328773721E-10,\r\n",
              "    &quot;L2Regularization&quot;: 0.49094435684206666,\r\n",
              "    &quot;LabelColumnName&quot;: &quot;y&quot;,\r\n",
              "    &quot;FeatureColumnName&quot;: &quot;Features&quot;\r\n",
              "  }\r\n",
              "}</p></div><div><h3>Plot Metrics over Trials</h3></div>\n",
              "<div>\n",
              "    <div id=\"78072105-37cd-4bb6-9216-0aed4eda83d8\"><!-- Plotly chart will be drawn inside this DIV --></div>\r\n",
              "<script type=\"text/javascript\">\r\n",
              "\r\n",
              "            var renderPlotly_7807210537cd4bb692160aed4eda83d8 = function() {\r\n",
              "            var fsharpPlotlyRequire = requirejs.config({context:'fsharp-plotly',paths:{plotly:'https://cdn.plot.ly/plotly-2.6.3.min'}}) || require;\r\n",
              "            fsharpPlotlyRequire(['plotly'], function(Plotly) {\r\n",
              "\r\n",
              "            var data = [{\"type\":\"scatter\",\"name\":\"Plot Metrics over Trials.\",\"mode\":\"markers\",\"x\":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128],\"y\":[30531504.718025338,3561386.8891544966,1099010.4466407755,785109.7253744178,25259037.600479428,3554086.608226187,26841140.921167668,298293.99932647287,29599696.354982026,2535787.652825082,1214121.2887640672,538889.0457910341,36128935.19564222,3567983.0924753817,494097.38960825966,323719.1983330976,45823904.27701145,305112.33299120225,379154.89658989594,268085.32275418076,551989.1826782973,327905.2506202788,293738.73497108754,26609144.826393593,4458588.425887769,162580.34837341504,301699.82746839465,29928866.08657654,3539946.891286853,189312.37317467993,1248659.276509034,1917350.186697243,45703751.631989814,192490.5958254102,255729.54572766717,590609.0627399393,248340.02367838295,40822724.72461371,227093.6868914514,438670.1072589804,353711.46811354766,193987.06431966598,44575407.19738165,155036.2218896326,72287.7077117432,209362.67260097447,45275068.48253891,189444.1371042109,270029.90435908415,147748.4205537411,189022.40081465043,270744.64595511655,45764815.11376172,85604.20437207987,117717.07281884215,41567.53557767989,28207702.321428135,38281.728374519495,104558.13533882228,25629013.2894428,38242.865609426444,60351.240928829895,99997.27052841797,107471.69218400911,45820991.3631035,1828145.2624978684,422078.9389429746,113525.00198543635,45823904.27701145,30189186.66678837,43696379.28040815,65461.517766672994,50329.730709488875,2190679.504452845,38242.865609426444,138216.6263905281,4117207.8319652933,65490.95612247631,29757000.21484619,82893.37263164944,72186.96519492875,52927.439763556955,933873.6262789418,87996.1242715544,42365.26500257666,49660.083439522234,38242.85129750678,87130.99786649527,38243.36802991626,42483.295733292354,32053798.1224118,72483.90351873929,8307140.803580037,153062.94674305356,84694.44883219931,55475.77657605679,46490.10966372908,89524.87189057957,38242.865609426444,42484.30889511387,24512817.164222732,54974.31495722883,48170.12725900492,44507.96590129613,145290.76429578243,55498.24729669549,38242.865609426444,46816.356764070544,205678.41842494716,41030.330910327655,38242.85129750678,39251.76210814879,40090.375273787555,71458.43160463125,38267.193952691945,47346.53070168755,40450.511836521306,13038899.315801134,1397614.6855616113,62356.73316727104,1340550.6863687916,3858263.910031681,37739.97909717355,40561.650648312956,5516126.8125961665,51068.31850218443,38182.22200630509,41154.15259256845,753022.3038241931],\"marker\":{},\"line\":{},\"showlegend\":false}];\r\n",
              "            var layout = {\"width\":600,\"height\":600,\"template\":{\"layout\":{\"title\":{\"x\":0.05},\"font\":{\"color\":\"rgba(42, 63, 95, 1.0)\"},\"paper_bgcolor\":\"rgba(255, 255, 255, 1.0)\",\"plot_bgcolor\":\"rgba(229, 236, 246, 1.0)\",\"autotypenumbers\":\"strict\",\"colorscale\":{\"diverging\":[[0.0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1.0,\"#276419\"]],\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}},\"geo\":{\"showland\":true,\"landcolor\":\"rgba(229, 236, 246, 1.0)\",\"showlakes\":true,\"lakecolor\":\"rgba(255, 255, 255, 1.0)\",\"subunitcolor\":\"rgba(255, 255, 255, 1.0)\",\"bgcolor\":\"rgba(255, 255, 255, 1.0)\"},\"mapbox\":{\"style\":\"light\"},\"polar\":{\"bgcolor\":\"rgba(229, 236, 246, 1.0)\",\"radialaxis\":{\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"ticks\":\"\"},\"angularaxis\":{\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"ticks\":\"\"}},\"scene\":{\"xaxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"gridwidth\":2.0,\"zerolinecolor\":\"rgba(255, 255, 255, 1.0)\",\"backgroundcolor\":\"rgba(229, 236, 246, 1.0)\",\"showbackground\":true},\"yaxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"gridwidth\":2.0,\"zerolinecolor\":\"rgba(255, 255, 255, 1.0)\",\"backgroundcolor\":\"rgba(229, 236, 246, 1.0)\",\"showbackground\":true},\"zaxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"gridwidth\":2.0,\"zerolinecolor\":\"rgba(255, 255, 255, 1.0)\",\"backgroundcolor\":\"rgba(229, 236, 246, 1.0)\",\"showbackground\":true}},\"ternary\":{\"aaxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\"},\"baxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\"},\"caxis\":{\"ticks\":\"\",\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\"},\"bgcolor\":\"rgba(229, 236, 246, 1.0)\"},\"xaxis\":{\"title\":{\"standoff\":15},\"ticks\":\"\",\"automargin\":true,\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"zerolinecolor\":\"rgba(255, 255, 255, 1.0)\",\"zerolinewidth\":2.0},\"yaxis\":{\"title\":{\"standoff\":15},\"ticks\":\"\",\"automargin\":true,\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"zerolinecolor\":\"rgba(255, 255, 255, 1.0)\",\"zerolinewidth\":2.0},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"shapedefaults\":{\"line\":{\"color\":\"rgba(42, 63, 95, 1.0)\"}},\"colorway\":[\"rgba(99, 110, 250, 1.0)\",\"rgba(239, 85, 59, 1.0)\",\"rgba(0, 204, 150, 1.0)\",\"rgba(171, 99, 250, 1.0)\",\"rgba(255, 161, 90, 1.0)\",\"rgba(25, 211, 243, 1.0)\",\"rgba(255, 102, 146, 1.0)\",\"rgba(182, 232, 128, 1.0)\",\"rgba(255, 151, 255, 1.0)\",\"rgba(254, 203, 82, 1.0)\"]},\"data\":{\"bar\":[{\"marker\":{\"line\":{\"color\":\"rgba(229, 236, 246, 1.0)\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"error_x\":{\"color\":\"rgba(42, 63, 95, 1.0)\"},\"error_y\":{\"color\":\"rgba(42, 63, 95, 1.0)\"}}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"rgba(229, 236, 246, 1.0)\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}}}],\"carpet\":[{\"aaxis\":{\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"endlinecolor\":\"rgba(42, 63, 95, 1.0)\",\"minorgridcolor\":\"rgba(255, 255, 255, 1.0)\",\"startlinecolor\":\"rgba(42, 63, 95, 1.0)\"},\"baxis\":{\"linecolor\":\"rgba(255, 255, 255, 1.0)\",\"gridcolor\":\"rgba(255, 255, 255, 1.0)\",\"endlinecolor\":\"rgba(42, 63, 95, 1.0)\",\"minorgridcolor\":\"rgba(255, 255, 255, 1.0)\",\"startlinecolor\":\"rgba(42, 63, 95, 1.0)\"}}],\"choropleth\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contour\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}],\"heatmap\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}}}],\"histogram2d\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"histogram2dcontour\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}],\"parcoords\":[{\"line\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"pie\":[{\"automargin\":true}],\"scatter\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}},\"line\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scattergeo\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scattergl\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"marker\":{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"}}}],\"surface\":[{\"colorbar\":{\"outlinewidth\":0.0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"rgba(235, 240, 248, 1.0)\"},\"line\":{\"color\":\"rgba(255, 255, 255, 1.0)\"}},\"header\":{\"fill\":{\"color\":\"rgba(200, 212, 227, 1.0)\"},\"line\":{\"color\":\"rgba(255, 255, 255, 1.0)\"}}}]}},\"xaxis\":{\"title\":{\"text\":\"Trial\"},\"showgrid\":false},\"yaxis\":{\"title\":{\"text\":\"Metric\"},\"showgrid\":false}};\r\n",
              "            var config = {\"responsive\":true};\r\n",
              "            Plotly.newPlot('78072105-37cd-4bb6-9216-0aed4eda83d8', data, layout, config);\r\n",
              "});\r\n",
              "            };\r\n",
              "            if ((typeof(requirejs) !==  typeof(Function)) || (typeof(requirejs.config) !== typeof(Function))) {\r\n",
              "                var script = document.createElement(\"script\");\r\n",
              "                script.setAttribute(\"src\", \"https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.6/require.min.js\");\r\n",
              "                script.onload = function(){\r\n",
              "                    renderPlotly_7807210537cd4bb692160aed4eda83d8();\r\n",
              "                };\r\n",
              "                document.getElementsByTagName(\"head\")[0].appendChild(script);\r\n",
              "            }\r\n",
              "            else {\r\n",
              "                renderPlotly_7807210537cd4bb692160aed4eda83d8();\r\n",
              "            }\r\n",
              "</script>\r\n",
              "\n",
              "    \n",
              "</div>    \n",
              "<div><h3>All Trials Table</h3></div><table id=\"table_637927895953012520\"><caption><h3 style=\"text-align: center;\">DataFrame - 129 rows </h3></caption><thead><tr><th><i>index</i></th><th>Trial</th><th>Metric</th><th>Trainer</th><th>Parameters</th></tr></thead><tbody><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">0</div></i></td><td><div class=\"dni-plaintext\">0</div></td><td><div class=\"dni-plaintext\">30531504</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:255,&quot;FeatureFraction&quot;:1,&quot;LearningRate&quot;:0.09999999999999998,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">1</div></i></td><td><div class=\"dni-plaintext\">1</div></td><td><div class=\"dni-plaintext\">3561387</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:1,&quot;NumberOfTrees&quot;:4,&quot;SubsampleFraction&quot;:1,&quot;MaximumBinCountPerFeature&quot;:255,&quot;FeatureFraction&quot;:1,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:1,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">2</div></i></td><td><div class=\"dni-plaintext\">2</div></td><td><div class=\"dni-plaintext\">1099010.5</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:10,&quot;MinimumExampleCountPerLeaf&quot;:22,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:5,&quot;SubsampleFraction&quot;:0.4105597890469192,&quot;MaximumBinCountPerFeature&quot;:270,&quot;FeatureFraction&quot;:0.969913489671833,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.8456655816409936,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">3</div></i></td><td><div class=\"dni-plaintext\">3</div></td><td><div class=\"dni-plaintext\">785109.75</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:13,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:5,&quot;SubsampleFraction&quot;:0.24430677292284939,&quot;MaximumBinCountPerFeature&quot;:101,&quot;FeatureFraction&quot;:0.9504444831863715,&quot;L1Regularization&quot;:5.161973530619877E-10,&quot;L2Regularization&quot;:0.9561008252339419,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">4</div></i></td><td><div class=\"dni-plaintext\">4</div></td><td><div class=\"dni-plaintext\">25259038</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:10,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.04507664645421794,&quot;NumberOfTrees&quot;:4,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:68,&quot;FeatureFraction&quot;:0.7773016744657335,&quot;L1Regularization&quot;:1.1948673587411898E-09,&quot;L2Regularization&quot;:0.04023280368563504,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">5</div></i></td><td><div class=\"dni-plaintext\">5</div></td><td><div class=\"dni-plaintext\">3554086.5</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:19,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:228,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">6</div></i></td><td><div class=\"dni-plaintext\">6</div></td><td><div class=\"dni-plaintext\">26841140</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:25,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:259,&quot;FeatureFraction&quot;:0.8435530636448995,&quot;LearningRate&quot;:0.24256533256590085,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">7</div></i></td><td><div class=\"dni-plaintext\">7</div></td><td><div class=\"dni-plaintext\">298294</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:16,&quot;MinimumExampleCountPerLeaf&quot;:27,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:12,&quot;SubsampleFraction&quot;:0.037345502694141754,&quot;MaximumBinCountPerFeature&quot;:152,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2.230035872675616E-10,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">8</div></i></td><td><div class=\"dni-plaintext\">8</div></td><td><div class=\"dni-plaintext\">29599696</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:69,&quot;MinimumExampleCountPerLeaf&quot;:26,&quot;LearningRate&quot;:0.0008768102414238946,&quot;NumberOfTrees&quot;:27,&quot;SubsampleFraction&quot;:0.0006743016056747878,&quot;MaximumBinCountPerFeature&quot;:63,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:4.580105308950293E-09,&quot;L2Regularization&quot;:0.09497366700984487,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">9</div></i></td><td><div class=\"dni-plaintext\">9</div></td><td><div class=\"dni-plaintext\">2535787.8</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:27,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:5,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:355,&quot;FeatureFraction&quot;:0.9670769917816898,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">10</div></i></td><td><div class=\"dni-plaintext\">10</div></td><td><div class=\"dni-plaintext\">1214121.2</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:7,&quot;MinimumExampleCountPerLeaf&quot;:14,&quot;NumberOfTrees&quot;:6,&quot;MaximumBinCountPerFeature&quot;:198,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">11</div></i></td><td><div class=\"dni-plaintext\">11</div></td><td><div class=\"dni-plaintext\">538889.06</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:16,&quot;MinimumExampleCountPerLeaf&quot;:19,&quot;NumberOfTrees&quot;:11,&quot;MaximumBinCountPerFeature&quot;:64,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.8727722252423372,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">12</div></i></td><td><div class=\"dni-plaintext\">12</div></td><td><div class=\"dni-plaintext\">36128936</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:22,&quot;MinimumExampleCountPerLeaf&quot;:2,&quot;NumberOfTrees&quot;:7,&quot;MaximumBinCountPerFeature&quot;:61,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.03343781745790658,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">13</div></i></td><td><div class=\"dni-plaintext\">13</div></td><td><div class=\"dni-plaintext\">3567983</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:4,&quot;SubsampleFraction&quot;:0.05483182113250001,&quot;MaximumBinCountPerFeature&quot;:195,&quot;FeatureFraction&quot;:0.9457109459825148,&quot;L1Regularization&quot;:8.020640844748272E-10,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">14</div></i></td><td><div class=\"dni-plaintext\">14</div></td><td><div class=\"dni-plaintext\">494097.38</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:11,&quot;MinimumExampleCountPerLeaf&quot;:121,&quot;NumberOfTrees&quot;:13,&quot;MaximumBinCountPerFeature&quot;:68,&quot;FeatureFraction&quot;:0.9262185158739559,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">15</div></i></td><td><div class=\"dni-plaintext\">15</div></td><td><div class=\"dni-plaintext\">323719.2</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:51,&quot;MinimumExampleCountPerLeaf&quot;:131,&quot;LearningRate&quot;:0.7093308247166462,&quot;NumberOfTrees&quot;:67,&quot;SubsampleFraction&quot;:0.025435714931078365,&quot;MaximumBinCountPerFeature&quot;:117,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.5142996402455946,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">16</div></i></td><td><div class=\"dni-plaintext\">16</div></td><td><div class=\"dni-plaintext\">45823904</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:190,&quot;MinimumExampleCountPerLeaf&quot;:126,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:11,&quot;FeatureFraction&quot;:0.655468631002646,&quot;LearningRate&quot;:0.06274703487895684,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">17</div></i></td><td><div class=\"dni-plaintext\">17</div></td><td><div class=\"dni-plaintext\">305112.34</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:13,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.8238128428180048,&quot;NumberOfTrees&quot;:15,&quot;SubsampleFraction&quot;:0.25654178835020774,&quot;MaximumBinCountPerFeature&quot;:253,&quot;FeatureFraction&quot;:0.9216286130780658,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">18</div></i></td><td><div class=\"dni-plaintext\">18</div></td><td><div class=\"dni-plaintext\">379154.9</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:19,&quot;MinimumExampleCountPerLeaf&quot;:63,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:9,&quot;SubsampleFraction&quot;:0.005436488848258312,&quot;MaximumBinCountPerFeature&quot;:89,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2.244784431389119E-09,&quot;L2Regularization&quot;:0.056207724387392154,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">19</div></i></td><td><div class=\"dni-plaintext\">19</div></td><td><div class=\"dni-plaintext\">268085.3</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:19,&quot;MinimumExampleCountPerLeaf&quot;:34,&quot;LearningRate&quot;:0.547122399993614,&quot;NumberOfTrees&quot;:13,&quot;SubsampleFraction&quot;:0.1334061820114081,&quot;MaximumBinCountPerFeature&quot;:244,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.03535451723734032,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">20</div></i></td><td><div class=\"dni-plaintext\">20</div></td><td><div class=\"dni-plaintext\">551989.2</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;NumberOfTrees&quot;:33,&quot;MaximumBinCountPerFeature&quot;:392,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">21</div></i></td><td><div class=\"dni-plaintext\">21</div></td><td><div class=\"dni-plaintext\">327905.25</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:11,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.3377301127453049,&quot;NumberOfTrees&quot;:24,&quot;SubsampleFraction&quot;:0.6823920622570101,&quot;MaximumBinCountPerFeature&quot;:476,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:1.8796823107768616E-09,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">22</div></i></td><td><div class=\"dni-plaintext\">22</div></td><td><div class=\"dni-plaintext\">293738.75</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:33,&quot;MinimumExampleCountPerLeaf&quot;:57,&quot;LearningRate&quot;:0.8863376680909649,&quot;NumberOfTrees&quot;:6,&quot;SubsampleFraction&quot;:0.026080621952132215,&quot;MaximumBinCountPerFeature&quot;:123,&quot;FeatureFraction&quot;:0.9895031517315499,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.00040044807570003676,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">23</div></i></td><td><div class=\"dni-plaintext\">23</div></td><td><div class=\"dni-plaintext\">26609144</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:62,&quot;MinimumExampleCountPerLeaf&quot;:49,&quot;LearningRate&quot;:0.03206317798750253,&quot;NumberOfTrees&quot;:4,&quot;SubsampleFraction&quot;:0.032183553045326226,&quot;MaximumBinCountPerFeature&quot;:275,&quot;FeatureFraction&quot;:0.9509481816435067,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.06561280617185666,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">24</div></i></td><td><div class=\"dni-plaintext\">24</div></td><td><div class=\"dni-plaintext\">4458588.5</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:65,&quot;MinimumExampleCountPerLeaf&quot;:126,&quot;NumberOfTrees&quot;:54,&quot;MaximumBinCountPerFeature&quot;:8,&quot;FeatureFraction&quot;:0.7335040770439581,&quot;LearningRate&quot;:0.09913115176839614,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">25</div></i></td><td><div class=\"dni-plaintext\">25</div></td><td><div class=\"dni-plaintext\">162580.34</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:22,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:99,&quot;SubsampleFraction&quot;:0.5529908203048919,&quot;MaximumBinCountPerFeature&quot;:214,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2.7959831765123043E-10,&quot;L2Regularization&quot;:0.019050273292861113,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">26</div></i></td><td><div class=\"dni-plaintext\">26</div></td><td><div class=\"dni-plaintext\">301699.8</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:23,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:192,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:117,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.0008407744908890112,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">27</div></i></td><td><div class=\"dni-plaintext\">27</div></td><td><div class=\"dni-plaintext\">29928866</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:34,&quot;LearningRate&quot;:0.00026144856499381303,&quot;NumberOfTrees&quot;:51,&quot;SubsampleFraction&quot;:0.21928219147498285,&quot;MaximumBinCountPerFeature&quot;:393,&quot;FeatureFraction&quot;:0.8949305336101089,&quot;L1Regularization&quot;:6.430471092650963E-10,&quot;L2Regularization&quot;:0.4316412028021491,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">28</div></i></td><td><div class=\"dni-plaintext\">28</div></td><td><div class=\"dni-plaintext\">3539947</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:74,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">29</div></i></td><td><div class=\"dni-plaintext\">29</div></td><td><div class=\"dni-plaintext\">189312.38</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:9,&quot;MinimumExampleCountPerLeaf&quot;:70,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:59,&quot;SubsampleFraction&quot;:0.0011949995126353703,&quot;MaximumBinCountPerFeature&quot;:324,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.15369870716693498,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">30</div></i></td><td><div class=\"dni-plaintext\">30</div></td><td><div class=\"dni-plaintext\">1248659.2</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:22,&quot;MinimumExampleCountPerLeaf&quot;:126,&quot;NumberOfTrees&quot;:40,&quot;MaximumBinCountPerFeature&quot;:27,&quot;FeatureFraction&quot;:0.9402994749638851,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">31</div></i></td><td><div class=\"dni-plaintext\">31</div></td><td><div class=\"dni-plaintext\">1917350.1</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.01939676720822791,&quot;NumberOfTrees&quot;:159,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:141,&quot;FeatureFraction&quot;:0.9673759738011097,&quot;L1Regularization&quot;:2.206425308061312E-09,&quot;L2Regularization&quot;:0.002361196910645,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">32</div></i></td><td><div class=\"dni-plaintext\">32</div></td><td><div class=\"dni-plaintext\">45703750</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:5,&quot;MinimumExampleCountPerLeaf&quot;:39,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:168,&quot;FeatureFraction&quot;:0.9121375567840266,&quot;LearningRate&quot;:0.0008963581203566989,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">33</div></i></td><td><div class=\"dni-plaintext\">33</div></td><td><div class=\"dni-plaintext\">192490.6</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.533532501190781,&quot;NumberOfTrees&quot;:130,&quot;SubsampleFraction&quot;:0.3078074725901261,&quot;MaximumBinCountPerFeature&quot;:337,&quot;FeatureFraction&quot;:0.9616277275493356,&quot;L1Regularization&quot;:8.491178620921657E-08,&quot;L2Regularization&quot;:0.40632605116344606,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">34</div></i></td><td><div class=\"dni-plaintext\">34</div></td><td><div class=\"dni-plaintext\">255729.55</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:10,&quot;MinimumExampleCountPerLeaf&quot;:23,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:74,&quot;SubsampleFraction&quot;:0.9934744103781925,&quot;MaximumBinCountPerFeature&quot;:136,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.0008931568908603265,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">35</div></i></td><td><div class=\"dni-plaintext\">35</div></td><td><div class=\"dni-plaintext\">590609.06</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:11,&quot;MinimumExampleCountPerLeaf&quot;:79,&quot;NumberOfTrees&quot;:9,&quot;MaximumBinCountPerFeature&quot;:137,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">36</div></i></td><td><div class=\"dni-plaintext\">36</div></td><td><div class=\"dni-plaintext\">248340.03</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:13,&quot;MinimumExampleCountPerLeaf&quot;:22,&quot;LearningRate&quot;:0.49388893539490425,&quot;NumberOfTrees&quot;:95,&quot;SubsampleFraction&quot;:0.5874776763518562,&quot;MaximumBinCountPerFeature&quot;:135,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.0053322917361391785,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">37</div></i></td><td><div class=\"dni-plaintext\">37</div></td><td><div class=\"dni-plaintext\">40822724</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:10,&quot;MinimumExampleCountPerLeaf&quot;:126,&quot;NumberOfTrees&quot;:18,&quot;MaximumBinCountPerFeature&quot;:32,&quot;FeatureFraction&quot;:0.7709220597055316,&quot;LearningRate&quot;:0.008901131938634002,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">38</div></i></td><td><div class=\"dni-plaintext\">38</div></td><td><div class=\"dni-plaintext\">227093.69</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:21,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:101,&quot;SubsampleFraction&quot;:0.520528455209464,&quot;MaximumBinCountPerFeature&quot;:339,&quot;FeatureFraction&quot;:0.855233739495514,&quot;L1Regularization&quot;:8.115869075233364E-10,&quot;L2Regularization&quot;:0.06805946307721393,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">39</div></i></td><td><div class=\"dni-plaintext\">39</div></td><td><div class=\"dni-plaintext\">438670.1</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:18,&quot;MinimumExampleCountPerLeaf&quot;:62,&quot;NumberOfTrees&quot;:30,&quot;MaximumBinCountPerFeature&quot;:77,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">40</div></i></td><td><div class=\"dni-plaintext\">40</div></td><td><div class=\"dni-plaintext\">353711.47</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:5,&quot;MinimumExampleCountPerLeaf&quot;:24,&quot;LearningRate&quot;:0.1865221887783344,&quot;NumberOfTrees&quot;:113,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:159,&quot;FeatureFraction&quot;:0.9520303670693604,&quot;L1Regularization&quot;:3.9238221297746527E-10,&quot;L2Regularization&quot;:0.009157464940208398,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">41</div></i></td><td><div class=\"dni-plaintext\">41</div></td><td><div class=\"dni-plaintext\">193987.06</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:90,&quot;MinimumExampleCountPerLeaf&quot;:81,&quot;NumberOfTrees&quot;:10,&quot;MaximumBinCountPerFeature&quot;:198,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.6399674672037565,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">42</div></i></td><td><div class=\"dni-plaintext\">42</div></td><td><div class=\"dni-plaintext\">44575410</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:38,&quot;MinimumExampleCountPerLeaf&quot;:93,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:57,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.0068888874916624866,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">43</div></i></td><td><div class=\"dni-plaintext\">43</div></td><td><div class=\"dni-plaintext\">155036.22</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:86,&quot;SubsampleFraction&quot;:0.11384861636207586,&quot;MaximumBinCountPerFeature&quot;:287,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.03963028140454322,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">44</div></i></td><td><div class=\"dni-plaintext\">44</div></td><td><div class=\"dni-plaintext\">72287.71</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:208,&quot;MinimumExampleCountPerLeaf&quot;:69,&quot;NumberOfTrees&quot;:190,&quot;MaximumBinCountPerFeature&quot;:671,&quot;FeatureFraction&quot;:0.9172351322665542,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">45</div></i></td><td><div class=\"dni-plaintext\">45</div></td><td><div class=\"dni-plaintext\">209362.67</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:59,&quot;SubsampleFraction&quot;:0.02785120753504956,&quot;MaximumBinCountPerFeature&quot;:259,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:7.180349476583783E-10,&quot;L2Regularization&quot;:0.004622452130511352,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">46</div></i></td><td><div class=\"dni-plaintext\">46</div></td><td><div class=\"dni-plaintext\">45275068</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:46,&quot;MinimumExampleCountPerLeaf&quot;:89,&quot;NumberOfTrees&quot;:2038,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8155655254912705,&quot;LearningRate&quot;:7.1857879157336315E-06,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">47</div></i></td><td><div class=\"dni-plaintext\">47</div></td><td><div class=\"dni-plaintext\">189444.14</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:23,&quot;LearningRate&quot;:0.048885087221179645,&quot;NumberOfTrees&quot;:121,&quot;SubsampleFraction&quot;:0.4653840387799207,&quot;MaximumBinCountPerFeature&quot;:317,&quot;FeatureFraction&quot;:0.9198715469987667,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.3397675432562119,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">48</div></i></td><td><div class=\"dni-plaintext\">48</div></td><td><div class=\"dni-plaintext\">270029.9</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:940,&quot;MinimumExampleCountPerLeaf&quot;:53,&quot;NumberOfTrees&quot;:17,&quot;MaximumBinCountPerFeature&quot;:125,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">49</div></i></td><td><div class=\"dni-plaintext\">49</div></td><td><div class=\"dni-plaintext\">147748.42</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:12,&quot;MinimumExampleCountPerLeaf&quot;:21,&quot;LearningRate&quot;:0.8633098671791535,&quot;NumberOfTrees&quot;:206,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:237,&quot;FeatureFraction&quot;:0.951968067381796,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.06474528805557125,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">50</div></i></td><td><div class=\"dni-plaintext\">50</div></td><td><div class=\"dni-plaintext\">189022.4</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:574,&quot;MinimumExampleCountPerLeaf&quot;:117,&quot;NumberOfTrees&quot;:19,&quot;MaximumBinCountPerFeature&quot;:677,&quot;FeatureFraction&quot;:0.7638706089478781,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">51</div></i></td><td><div class=\"dni-plaintext\">51</div></td><td><div class=\"dni-plaintext\">270744.66</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:11,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.023181290794055297,&quot;NumberOfTrees&quot;:275,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:129,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.0744060833816065,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">52</div></i></td><td><div class=\"dni-plaintext\">52</div></td><td><div class=\"dni-plaintext\">45764816</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:75,&quot;MinimumExampleCountPerLeaf&quot;:39,&quot;NumberOfTrees&quot;:1741,&quot;MaximumBinCountPerFeature&quot;:662,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:7.40750590609753E-07,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">53</div></i></td><td><div class=\"dni-plaintext\">53</div></td><td><div class=\"dni-plaintext\">85604.2</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:12,&quot;MinimumExampleCountPerLeaf&quot;:42,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:153,&quot;SubsampleFraction&quot;:0.10103378347446892,&quot;MaximumBinCountPerFeature&quot;:432,&quot;FeatureFraction&quot;:0.8457396811606516,&quot;L1Regularization&quot;:8.046125260962513E-10,&quot;L2Regularization&quot;:0.0563388386390348,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">54</div></i></td><td><div class=\"dni-plaintext\">54</div></td><td><div class=\"dni-plaintext\">117717.07</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:5,&quot;MinimumExampleCountPerLeaf&quot;:28,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:324,&quot;SubsampleFraction&quot;:0.1493389626989633,&quot;MaximumBinCountPerFeature&quot;:310,&quot;FeatureFraction&quot;:0.99999999,&quot;L1Regularization&quot;:6.430294495551263E-08,&quot;L2Regularization&quot;:0.008440976586962707,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">55</div></i></td><td><div class=\"dni-plaintext\">55</div></td><td><div class=\"dni-plaintext\">41567.535</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:26,&quot;MinimumExampleCountPerLeaf&quot;:32,&quot;NumberOfTrees&quot;:258,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">56</div></i></td><td><div class=\"dni-plaintext\">56</div></td><td><div class=\"dni-plaintext\">28207702</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:25,&quot;MinimumExampleCountPerLeaf&quot;:61,&quot;LearningRate&quot;:0.0010009718279655327,&quot;NumberOfTrees&quot;:72,&quot;SubsampleFraction&quot;:0.0683533969881842,&quot;MaximumBinCountPerFeature&quot;:597,&quot;FeatureFraction&quot;:0.6050546045753876,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.37603051098348267,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">57</div></i></td><td><div class=\"dni-plaintext\">57</div></td><td><div class=\"dni-plaintext\">38281.727</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:24,&quot;MinimumExampleCountPerLeaf&quot;:13,&quot;NumberOfTrees&quot;:10965,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">58</div></i></td><td><div class=\"dni-plaintext\">58</div></td><td><div class=\"dni-plaintext\">104558.13</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:41,&quot;MinimumExampleCountPerLeaf&quot;:72,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:75,&quot;SubsampleFraction&quot;:0.004791286212953407,&quot;MaximumBinCountPerFeature&quot;:427,&quot;FeatureFraction&quot;:0.819039162727136,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.001677197872651411,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">59</div></i></td><td><div class=\"dni-plaintext\">59</div></td><td><div class=\"dni-plaintext\">25629014</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:24,&quot;LearningRate&quot;:0.0005805118663253576,&quot;NumberOfTrees&quot;:309,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:436,&quot;FeatureFraction&quot;:0.8724401995941671,&quot;L1Regularization&quot;:3.280848246056955E-08,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">60</div></i></td><td><div class=\"dni-plaintext\">60</div></td><td><div class=\"dni-plaintext\">38242.867</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:2244,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.9926351235068326,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">61</div></i></td><td><div class=\"dni-plaintext\">61</div></td><td><div class=\"dni-plaintext\">60351.242</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:25,&quot;MinimumExampleCountPerLeaf&quot;:56,&quot;LearningRate&quot;:0.0598088472438277,&quot;NumberOfTrees&quot;:631,&quot;SubsampleFraction&quot;:0.03802338056368373,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7624456920286922,&quot;L1Regularization&quot;:2.0451735862922067E-09,&quot;L2Regularization&quot;:0.027915843708719315,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">62</div></i></td><td><div class=\"dni-plaintext\">62</div></td><td><div class=\"dni-plaintext\">99997.27</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4252,&quot;MinimumExampleCountPerLeaf&quot;:126,&quot;NumberOfTrees&quot;:3819,&quot;MaximumBinCountPerFeature&quot;:902,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">63</div></i></td><td><div class=\"dni-plaintext\">63</div></td><td><div class=\"dni-plaintext\">107471.695</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:5,&quot;MinimumExampleCountPerLeaf&quot;:92,&quot;LearningRate&quot;:0.5150002945289655,&quot;NumberOfTrees&quot;:987,&quot;SubsampleFraction&quot;:6.938711609369426E-05,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.9497595263231705,&quot;L1Regularization&quot;:1.9072475531910624E-07,&quot;L2Regularization&quot;:0.044973966196985064,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">64</div></i></td><td><div class=\"dni-plaintext\">64</div></td><td><div class=\"dni-plaintext\">45820990</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1184,&quot;MinimumExampleCountPerLeaf&quot;:2,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.774400740802568,&quot;LearningRate&quot;:6.356336272576792E-05,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">65</div></i></td><td><div class=\"dni-plaintext\">65</div></td><td><div class=\"dni-plaintext\">1828145.2</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:121,&quot;MinimumExampleCountPerLeaf&quot;:33,&quot;LearningRate&quot;:0.006945817792021336,&quot;NumberOfTrees&quot;:403,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:595,&quot;FeatureFraction&quot;:0.5751318577342137,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.017327676339603897,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">66</div></i></td><td><div class=\"dni-plaintext\">66</div></td><td><div class=\"dni-plaintext\">422078.94</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:88,&quot;MinimumExampleCountPerLeaf&quot;:2,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:81,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">67</div></i></td><td><div class=\"dni-plaintext\">67</div></td><td><div class=\"dni-plaintext\">113525</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:24,&quot;MinimumExampleCountPerLeaf&quot;:88,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:1641,&quot;SubsampleFraction&quot;:0.04232444268589842,&quot;MaximumBinCountPerFeature&quot;:399,&quot;FeatureFraction&quot;:0.7224732045075073,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.005323183197308078,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">68</div></i></td><td><div class=\"dni-plaintext\">68</div></td><td><div class=\"dni-plaintext\">45823904</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:32767,&quot;MinimumExampleCountPerLeaf&quot;:53,&quot;NumberOfTrees&quot;:112,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:2E-10,&quot;LearningRate&quot;:0.21549004989511972,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">69</div></i></td><td><div class=\"dni-plaintext\">69</div></td><td><div class=\"dni-plaintext\">30189186</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:25,&quot;MinimumExampleCountPerLeaf&quot;:34,&quot;LearningRate&quot;:1.6376898027257134E-05,&quot;NumberOfTrees&quot;:242,&quot;SubsampleFraction&quot;:0.034159397684695864,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.802418179549877,&quot;L1Regularization&quot;:5.9446819176762324E-08,&quot;L2Regularization&quot;:0.1463963010635687,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">70</div></i></td><td><div class=\"dni-plaintext\">70</div></td><td><div class=\"dni-plaintext\">43696380</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:2,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:673,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.012140335592201216,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">71</div></i></td><td><div class=\"dni-plaintext\">71</div></td><td><div class=\"dni-plaintext\">65461.52</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:81,&quot;MinimumExampleCountPerLeaf&quot;:53,&quot;LearningRate&quot;:0.31115942199438185,&quot;NumberOfTrees&quot;:1666,&quot;SubsampleFraction&quot;:0.2444604749820639,&quot;MaximumBinCountPerFeature&quot;:615,&quot;FeatureFraction&quot;:0.7265555173403688,&quot;L1Regularization&quot;:1.9673040638024313E-07,&quot;L2Regularization&quot;:0.155196382000042,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">72</div></i></td><td><div class=\"dni-plaintext\">72</div></td><td><div class=\"dni-plaintext\">50329.73</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:32767,&quot;MinimumExampleCountPerLeaf&quot;:12,&quot;NumberOfTrees&quot;:6,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8253147691302776,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">73</div></i></td><td><div class=\"dni-plaintext\">73</div></td><td><div class=\"dni-plaintext\">2190679.5</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:58,&quot;LearningRate&quot;:0.011496030509724059,&quot;NumberOfTrees&quot;:238,&quot;SubsampleFraction&quot;:0.005914156346120157,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7983358667170155,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.005021343409728667,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">74</div></i></td><td><div class=\"dni-plaintext\">74</div></td><td><div class=\"dni-plaintext\">38242.867</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:32767,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">75</div></i></td><td><div class=\"dni-plaintext\">75</div></td><td><div class=\"dni-plaintext\">138216.62</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:7,&quot;MinimumExampleCountPerLeaf&quot;:48,&quot;LearningRate&quot;:0.12050193931245969,&quot;NumberOfTrees&quot;:623,&quot;SubsampleFraction&quot;:0.027586157565208394,&quot;MaximumBinCountPerFeature&quot;:513,&quot;FeatureFraction&quot;:0.7311718136914312,&quot;L1Regularization&quot;:3.622897834154604E-09,&quot;L2Regularization&quot;:0.1557461898853281,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">76</div></i></td><td><div class=\"dni-plaintext\">76</div></td><td><div class=\"dni-plaintext\">4117207.8</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:71,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:118,&quot;MaximumBinCountPerFeature&quot;:557,&quot;FeatureFraction&quot;:0.739152484660177,&quot;LearningRate&quot;:0.02640211090136866,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">77</div></i></td><td><div class=\"dni-plaintext\">77</div></td><td><div class=\"dni-plaintext\">65490.957</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:74,&quot;MinimumExampleCountPerLeaf&quot;:64,&quot;LearningRate&quot;:0.029684984565768322,&quot;NumberOfTrees&quot;:638,&quot;SubsampleFraction&quot;:0.052409526990962046,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7937195703659531,&quot;L1Regularization&quot;:1.1545274499973195E-09,&quot;L2Regularization&quot;:0.005003617299039019,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">78</div></i></td><td><div class=\"dni-plaintext\">78</div></td><td><div class=\"dni-plaintext\">29757000</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:32767,&quot;MinimumExampleCountPerLeaf&quot;:7,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:329,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.10231015231104659,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">79</div></i></td><td><div class=\"dni-plaintext\">79</div></td><td><div class=\"dni-plaintext\">82893.375</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:40,&quot;MinimumExampleCountPerLeaf&quot;:85,&quot;LearningRate&quot;:0.07461814161541361,&quot;NumberOfTrees&quot;:460,&quot;SubsampleFraction&quot;:0.017745897283766843,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7696998795808391,&quot;L1Regularization&quot;:4.307932507716276E-09,&quot;L2Regularization&quot;:0.011149880994209606,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">80</div></i></td><td><div class=\"dni-plaintext\">80</div></td><td><div class=\"dni-plaintext\">72186.97</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:150,&quot;MinimumExampleCountPerLeaf&quot;:2,&quot;NumberOfTrees&quot;:5,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.9598695730930918,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">81</div></i></td><td><div class=\"dni-plaintext\">81</div></td><td><div class=\"dni-plaintext\">52927.44</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:15,&quot;MinimumExampleCountPerLeaf&quot;:35,&quot;LearningRate&quot;:0.04793872014492261,&quot;NumberOfTrees&quot;:863,&quot;SubsampleFraction&quot;:0.08147108294226713,&quot;MaximumBinCountPerFeature&quot;:948,&quot;FeatureFraction&quot;:0.7551915044765453,&quot;L1Regularization&quot;:9.709379129258135E-10,&quot;L2Regularization&quot;:0.0698926141341194,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">82</div></i></td><td><div class=\"dni-plaintext\">82</div></td><td><div class=\"dni-plaintext\">933873.6</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:9056,&quot;MinimumExampleCountPerLeaf&quot;:7,&quot;NumberOfTrees&quot;:17,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8879526429665756,&quot;LearningRate&quot;:0.24264080024988885,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">83</div></i></td><td><div class=\"dni-plaintext\">83</div></td><td><div class=\"dni-plaintext\">87996.125</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4,&quot;MinimumExampleCountPerLeaf&quot;:28,&quot;LearningRate&quot;:0.02095599898839547,&quot;NumberOfTrees&quot;:900,&quot;SubsampleFraction&quot;:0.9999997766729865,&quot;MaximumBinCountPerFeature&quot;:1007,&quot;FeatureFraction&quot;:0.7504248483457794,&quot;L1Regularization&quot;:1.941851934394839E-09,&quot;L2Regularization&quot;:0.07572559629341716,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">84</div></i></td><td><div class=\"dni-plaintext\">84</div></td><td><div class=\"dni-plaintext\">42365.266</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:555,&quot;MinimumExampleCountPerLeaf&quot;:3,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:893,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">85</div></i></td><td><div class=\"dni-plaintext\">85</div></td><td><div class=\"dni-plaintext\">49660.082</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:48,&quot;MinimumExampleCountPerLeaf&quot;:45,&quot;LearningRate&quot;:0.10966410574870757,&quot;NumberOfTrees&quot;:828,&quot;SubsampleFraction&quot;:0.0031431436921025395,&quot;MaximumBinCountPerFeature&quot;:892,&quot;FeatureFraction&quot;:0.7599581606073111,&quot;L1Regularization&quot;:4.854749294005892E-10,&quot;L2Regularization&quot;:0.06450893422579176,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">86</div></i></td><td><div class=\"dni-plaintext\">86</div></td><td><div class=\"dni-plaintext\">38242.85</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1332,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8955932530110897,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">87</div></i></td><td><div class=\"dni-plaintext\">87</div></td><td><div class=\"dni-plaintext\">87131</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:37,&quot;MinimumExampleCountPerLeaf&quot;:56,&quot;LearningRate&quot;:0.021388563544235142,&quot;NumberOfTrees&quot;:366,&quot;SubsampleFraction&quot;:0.5591782140943159,&quot;MaximumBinCountPerFeature&quot;:513,&quot;FeatureFraction&quot;:0.8481513074028575,&quot;L1Regularization&quot;:1.0786437881937209E-09,&quot;L2Regularization&quot;:0.45286187068459743,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">88</div></i></td><td><div class=\"dni-plaintext\">88</div></td><td><div class=\"dni-plaintext\">38243.367</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:393,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:9,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7381941324280726,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">89</div></i></td><td><div class=\"dni-plaintext\">89</div></td><td><div class=\"dni-plaintext\">42483.297</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:63,&quot;MinimumExampleCountPerLeaf&quot;:34,&quot;LearningRate&quot;:0.5622732010399614,&quot;NumberOfTrees&quot;:1870,&quot;SubsampleFraction&quot;:1.7667627279087135E-05,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.6717650138117648,&quot;L1Regularization&quot;:2.1850207608499015E-10,&quot;L2Regularization&quot;:0.009189121152232754,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">90</div></i></td><td><div class=\"dni-plaintext\">90</div></td><td><div class=\"dni-plaintext\">32053798</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:4506,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:588,&quot;FeatureFraction&quot;:0.99999999,&quot;LearningRate&quot;:0.08546107293191833,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">91</div></i></td><td><div class=\"dni-plaintext\">91</div></td><td><div class=\"dni-plaintext\">72483.91</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:6,&quot;MinimumExampleCountPerLeaf&quot;:40,&quot;LearningRate&quot;:0.03765357110118144,&quot;NumberOfTrees&quot;:5131,&quot;SubsampleFraction&quot;:4.265208208586337E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7984631937417737,&quot;L1Regularization&quot;:1.5839317860524156E-09,&quot;L2Regularization&quot;:0.1346505525380082,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">92</div></i></td><td><div class=\"dni-plaintext\">92</div></td><td><div class=\"dni-plaintext\">8307141</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:762,&quot;MinimumExampleCountPerLeaf&quot;:3,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:345,&quot;FeatureFraction&quot;:0.932024232973707,&quot;LearningRate&quot;:0.43385635899122516,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">93</div></i></td><td><div class=\"dni-plaintext\">93</div></td><td><div class=\"dni-plaintext\">153062.95</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:566,&quot;MinimumExampleCountPerLeaf&quot;:30,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:681,&quot;SubsampleFraction&quot;:7.318401316127106E-05,&quot;MaximumBinCountPerFeature&quot;:224,&quot;FeatureFraction&quot;:0.5450668338817558,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.0006271043524056559,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">94</div></i></td><td><div class=\"dni-plaintext\">94</div></td><td><div class=\"dni-plaintext\">84694.445</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:2323,&quot;MinimumExampleCountPerLeaf&quot;:11,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8591622730484726,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">95</div></i></td><td><div class=\"dni-plaintext\">95</div></td><td><div class=\"dni-plaintext\">55475.777</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:70,&quot;MinimumExampleCountPerLeaf&quot;:59,&quot;LearningRate&quot;:0.02694488816152009,&quot;NumberOfTrees&quot;:435,&quot;SubsampleFraction&quot;:0.010170279623133136,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.5439298281681084,&quot;L1Regularization&quot;:6.094042606681515E-10,&quot;L2Regularization&quot;:0.0002495611119087252,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">96</div></i></td><td><div class=\"dni-plaintext\">96</div></td><td><div class=\"dni-plaintext\">46490.11</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:902,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:13,&quot;MaximumBinCountPerFeature&quot;:829,&quot;FeatureFraction&quot;:0.8207366158741456,&quot;LearningRate&quot;:0.8832670211616395,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">97</div></i></td><td><div class=\"dni-plaintext\">97</div></td><td><div class=\"dni-plaintext\">89524.875</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:56,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:8015,&quot;SubsampleFraction&quot;:3.069188510439216E-08,&quot;MaximumBinCountPerFeature&quot;:392,&quot;FeatureFraction&quot;:0.799600199455421,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.3383537879943994,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">98</div></i></td><td><div class=\"dni-plaintext\">98</div></td><td><div class=\"dni-plaintext\">38242.867</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1966,&quot;MinimumExampleCountPerLeaf&quot;:7,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.970449890148034,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">99</div></i></td><td><div class=\"dni-plaintext\">99</div></td><td><div class=\"dni-plaintext\">42484.31</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:48,&quot;MinimumExampleCountPerLeaf&quot;:30,&quot;LearningRate&quot;:0.03264038296263317,&quot;NumberOfTrees&quot;:3185,&quot;SubsampleFraction&quot;:2.4973502222117003E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.70623600918795,&quot;L1Regularization&quot;:1.4233495426177922E-08,&quot;L2Regularization&quot;:0.0001474959150683245,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">100</div></i></td><td><div class=\"dni-plaintext\">100</div></td><td><div class=\"dni-plaintext\">24512818</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1733,&quot;MinimumExampleCountPerLeaf&quot;:7,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.860077830599006,&quot;LearningRate&quot;:0.2685864801957094,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">101</div></i></td><td><div class=\"dni-plaintext\">101</div></td><td><div class=\"dni-plaintext\">54974.316</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:79,&quot;MinimumExampleCountPerLeaf&quot;:38,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:1097,&quot;SubsampleFraction&quot;:0.00012499050028966392,&quot;MaximumBinCountPerFeature&quot;:819,&quot;FeatureFraction&quot;:0.6372940184355794,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.5724900754796924,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">102</div></i></td><td><div class=\"dni-plaintext\">102</div></td><td><div class=\"dni-plaintext\">48170.13</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1023,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:752,&quot;FeatureFraction&quot;:0.9311086754231735,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">103</div></i></td><td><div class=\"dni-plaintext\">103</div></td><td><div class=\"dni-plaintext\">44507.965</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:42,&quot;MinimumExampleCountPerLeaf&quot;:21,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:2967,&quot;SubsampleFraction&quot;:0.00013499581100532014,&quot;MaximumBinCountPerFeature&quot;:855,&quot;FeatureFraction&quot;:0.6239720355749961,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.07015352115721794,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">104</div></i></td><td><div class=\"dni-plaintext\">104</div></td><td><div class=\"dni-plaintext\">145290.77</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1555,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:730,&quot;FeatureFraction&quot;:0.8537905743042978,&quot;LearningRate&quot;:0.9443244196376549,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">105</div></i></td><td><div class=\"dni-plaintext\">105</div></td><td><div class=\"dni-plaintext\">55498.246</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:92,&quot;MinimumExampleCountPerLeaf&quot;:56,&quot;LearningRate&quot;:0.28841640663936113,&quot;NumberOfTrees&quot;:1178,&quot;SubsampleFraction&quot;:2.312257331158537E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7195579920485333,&quot;L1Regularization&quot;:1.0880010509847752E-09,&quot;L2Regularization&quot;:0.0012036451792801215,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">106</div></i></td><td><div class=\"dni-plaintext\">106</div></td><td><div class=\"dni-plaintext\">38242.867</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1140,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.9373959317178817,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">107</div></i></td><td><div class=\"dni-plaintext\">107</div></td><td><div class=\"dni-plaintext\">46816.355</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:66,&quot;MinimumExampleCountPerLeaf&quot;:43,&quot;LearningRate&quot;:0.5864343425298729,&quot;NumberOfTrees&quot;:2354,&quot;SubsampleFraction&quot;:9.329719356879675E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.6912885153226777,&quot;L1Regularization&quot;:1.0783654202757387E-09,&quot;L2Regularization&quot;:0.0010414791701259588,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">108</div></i></td><td><div class=\"dni-plaintext\">108</div></td><td><div class=\"dni-plaintext\">205678.42</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1221,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:859,&quot;FeatureFraction&quot;:0.9000671354717583,&quot;LearningRate&quot;:0.9336102367098623,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">109</div></i></td><td><div class=\"dni-plaintext\">109</div></td><td><div class=\"dni-plaintext\">41030.332</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:59,&quot;MinimumExampleCountPerLeaf&quot;:27,&quot;LearningRate&quot;:0.5391075004984383,&quot;NumberOfTrees&quot;:1485,&quot;SubsampleFraction&quot;:3.345706786373698E-05,&quot;MaximumBinCountPerFeature&quot;:968,&quot;FeatureFraction&quot;:0.6522415123008518,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.08107694322892607,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">110</div></i></td><td><div class=\"dni-plaintext\">110</div></td><td><div class=\"dni-plaintext\">38242.85</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1452,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8911193705504212,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">111</div></i></td><td><div class=\"dni-plaintext\">111</div></td><td><div class=\"dni-plaintext\">39251.76</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:66,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.01667651601497964,&quot;NumberOfTrees&quot;:1593,&quot;SubsampleFraction&quot;:5.639854362419069E-06,&quot;MaximumBinCountPerFeature&quot;:998,&quot;FeatureFraction&quot;:0.6528815963503698,&quot;L1Regularization&quot;:7.767245536045459E-10,&quot;L2Regularization&quot;:0.481966082869489,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">112</div></i></td><td><div class=\"dni-plaintext\">112</div></td><td><div class=\"dni-plaintext\">40090.375</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1473,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:942,&quot;FeatureFraction&quot;:0.8862456323377591,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">113</div></i></td><td><div class=\"dni-plaintext\">113</div></td><td><div class=\"dni-plaintext\">71458.43</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:46,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.009220692991708784,&quot;NumberOfTrees&quot;:751,&quot;SubsampleFraction&quot;:5.848465092899202E-05,&quot;MaximumBinCountPerFeature&quot;:569,&quot;FeatureFraction&quot;:0.7735711024328747,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.717179454002124,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">114</div></i></td><td><div class=\"dni-plaintext\">114</div></td><td><div class=\"dni-plaintext\">38267.195</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1204,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.9049408736844204,&quot;LearningRate&quot;:0.9881736106152329,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">115</div></i></td><td><div class=\"dni-plaintext\">115</div></td><td><div class=\"dni-plaintext\">47346.53</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:92,&quot;MinimumExampleCountPerLeaf&quot;:46,&quot;LearningRate&quot;:0.030161093818864216,&quot;NumberOfTrees&quot;:3378,&quot;SubsampleFraction&quot;:5.438684633326512E-07,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.5321920902678648,&quot;L1Regularization&quot;:5.614844799439205E-09,&quot;L2Regularization&quot;:0.3238956494644243,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">116</div></i></td><td><div class=\"dni-plaintext\">116</div></td><td><div class=\"dni-plaintext\">40450.51</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1249,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:930,&quot;FeatureFraction&quot;:0.8915520078251896,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">117</div></i></td><td><div class=\"dni-plaintext\">117</div></td><td><div class=\"dni-plaintext\">13038899</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:28,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.0002105919932140364,&quot;NumberOfTrees&quot;:4022,&quot;SubsampleFraction&quot;:1.3110789097190567E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.7039585636478047,&quot;L1Regularization&quot;:6.762189022860614E-09,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">118</div></i></td><td><div class=\"dni-plaintext\">118</div></td><td><div class=\"dni-plaintext\">1397614.6</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1420,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8996344981969899,&quot;LearningRate&quot;:0.8252056309572793,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">119</div></i></td><td><div class=\"dni-plaintext\">119</div></td><td><div class=\"dni-plaintext\">62356.734</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:153,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.9999997766729865,&quot;NumberOfTrees&quot;:630,&quot;SubsampleFraction&quot;:2.4260902218397622E-05,&quot;MaximumBinCountPerFeature&quot;:603,&quot;FeatureFraction&quot;:0.6018046290529349,&quot;L1Regularization&quot;:2E-10,&quot;L2Regularization&quot;:0.027429798145353325,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">120</div></i></td><td><div class=\"dni-plaintext\">120</div></td><td><div class=\"dni-plaintext\">1340550.6</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1341,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.892631762112703,&quot;LearningRate&quot;:0.8288060051583632,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">121</div></i></td><td><div class=\"dni-plaintext\">121</div></td><td><div class=\"dni-plaintext\">3858264</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:48,&quot;MinimumExampleCountPerLeaf&quot;:26,&quot;LearningRate&quot;:0.0011943481196871066,&quot;NumberOfTrees&quot;:1733,&quot;SubsampleFraction&quot;:8.471542294054546E-07,&quot;MaximumBinCountPerFeature&quot;:900,&quot;FeatureFraction&quot;:0.7639537144479661,&quot;L1Regularization&quot;:2.7728949437229896E-10,&quot;L2Regularization&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">122</div></i></td><td><div class=\"dni-plaintext\">122</div></td><td><div class=\"dni-plaintext\">37739.98</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1322,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1012,&quot;FeatureFraction&quot;:0.8985547439094765,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">123</div></i></td><td><div class=\"dni-plaintext\">123</div></td><td><div class=\"dni-plaintext\">40561.652</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:87,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.2328518643883579,&quot;NumberOfTrees&quot;:1463,&quot;SubsampleFraction&quot;:3.7546831645544195E-05,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.5418094782527735,&quot;L1Regularization&quot;:2.175708219807872E-09,&quot;L2Regularization&quot;:0.14799557136713815,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">124</div></i></td><td><div class=\"dni-plaintext\">124</div></td><td><div class=\"dni-plaintext\">5516127</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1345,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.8859488959757784,&quot;LearningRate&quot;:0.6529661230985098,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">125</div></i></td><td><div class=\"dni-plaintext\">125</div></td><td><div class=\"dni-plaintext\">51068.32</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:41,&quot;MinimumExampleCountPerLeaf&quot;:20,&quot;LearningRate&quot;:0.046826543950932976,&quot;NumberOfTrees&quot;:1939,&quot;SubsampleFraction&quot;:7.856997816577964E-06,&quot;MaximumBinCountPerFeature&quot;:741,&quot;FeatureFraction&quot;:0.7272010539853043,&quot;L1Regularization&quot;:2.2337969336436185E-10,&quot;L2Regularization&quot;:0.616860813781697,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">126</div></i></td><td><div class=\"dni-plaintext\">126</div></td><td><div class=\"dni-plaintext\">38182.223</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1299,&quot;MinimumExampleCountPerLeaf&quot;:6,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:998,&quot;FeatureFraction&quot;:0.9111605918431745,&quot;LearningRate&quot;:0.9999997766729865,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">127</div></i></td><td><div class=\"dni-plaintext\">127</div></td><td><div class=\"dni-plaintext\">41154.152</div></td><td>LightGbmRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:102,&quot;MinimumExampleCountPerLeaf&quot;:24,&quot;LearningRate&quot;:0.005939071367070886,&quot;NumberOfTrees&quot;:1308,&quot;SubsampleFraction&quot;:4.0483601970950985E-06,&quot;MaximumBinCountPerFeature&quot;:1022,&quot;FeatureFraction&quot;:0.5785621387154353,&quot;L1Regularization&quot;:2.700787269808439E-09,&quot;L2Regularization&quot;:0.3765700460246216,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr><tr style=\"display: none\"><td><i><div class=\"dni-plaintext\">128</div></i></td><td><div class=\"dni-plaintext\">128</div></td><td><div class=\"dni-plaintext\">753022.3</div></td><td>FastTreeRegression</td><td>{&quot;0&quot;:{},&quot;1&quot;:{&quot;NumberOfLeaves&quot;:1126,&quot;MinimumExampleCountPerLeaf&quot;:4,&quot;NumberOfTrees&quot;:4,&quot;MaximumBinCountPerFeature&quot;:972,&quot;FeatureFraction&quot;:0.9052732461119847,&quot;LearningRate&quot;:0.8714931805897891,&quot;LabelColumnName&quot;:&quot;y&quot;,&quot;FeatureColumnName&quot;:&quot;Features&quot;}}</td></tr></tbody><tfoot><tr><td colspan=\"5\" style=\"text-align: center;\"><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = 1; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">⏮</button><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; page = parseInt(page) + parseInt(-10); page = page &lt; 0 ? 0 : page; page = page > 5 ? 5 : page; document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = page + 1; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">⏪</button><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; page = parseInt(page) + parseInt(-1); page = page &lt; 0 ? 0 : page; page = page > 5 ? 5 : page; document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = page + 1; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">◀️</button><b style=\"margin: 2px;\">Page</b><b id=\"page_637927895953012520\" style=\"margin: 2px;\">1</b><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; page = parseInt(page) + parseInt(1); page = page &lt; 0 ? 0 : page; page = page > 5 ? 5 : page; document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = page + 1; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">▶️</button><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; page = parseInt(page) + parseInt(10); page = page &lt; 0 ? 0 : page; page = page > 5 ? 5 : page; document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = page + 1; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">⏩</button><button style=\"margin: 2px;\" onclick=\"var allRows = document.querySelectorAll(&#39;#table_637927895953012520 tbody tr:nth-child(n)&#39;); for (let i = 0; i &lt; allRows.length; i++) { allRows[i].style.display=&#39;none&#39;; } document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML = 6; var page = parseInt(document.querySelector(&#39;#page_637927895953012520&#39;).innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j &lt; 25; j++) { pageRows[j].style.display=&#39;table-row&#39;; } \">⏭️</button></td></tr></tfoot></table><script>var page = parseInt(document.querySelector('#page_637927895953012520').innerHTML) - 1; var pageRows = document.querySelectorAll(`#table_637927895953012520 tbody tr:nth-child(n + ${page * 25 + 1 })`); for (let j = 0; j < 25; j++) { pageRows[j].style.display='table-row'; } </script>"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "var context =new MLContext(seed: 1);\n",
        "var pipeline = context.Transforms.Concatenate(\"Features\", \"X\")\n",
        "    .Append(context.Auto().Regression(\"y\", useLbfgs: false, useSdca: false, useFastForest: false));\n",
        "\n",
        "var monitor = new NotebookMonitor();\n",
        "var experiment = context.Auto().CreateExperiment();\n",
        "experiment.SetPipeline(pipeline)\n",
        "        .SetEvaluateMetric(RegressionMetric.RootMeanSquaredError, \"y\")\n",
        "        .SetTrainingTimeInSeconds(30)\n",
        "        .SetDataset(trainTestSplit.TrainSet, trainTestSplit.TestSet)\n",
        "        .SetMonitor(monitor);\n",
        "\n",
        "// Configure Visualizer\t\t\t\n",
        "monitor.SetUpdate(monitor.Display());\n",
        "\n",
        "var res = await experiment.RunAsync();"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Check model/metric from experiment result"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "dotnet_interactive": {
          "language": "csharp"
        },
        "vscode": {
          "languageId": "csharp"
        }
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<div class=\"dni-plaintext\">37739.97909717355</div>"
            ]
          },
          "execution_count": 1,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "// get model\n",
        "var model  = res.Model;\n",
        "var eval = model.Transform(trainTestSplit.TestSet);\n",
        "var metric = context.Regression.Evaluate(eval, \"y\");\n",
        "\n",
        "// should be identical with res.Metric\n",
        "metric.RootMeanSquaredError"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "# Continue learning\n",
        "\n",
        "> [⏩ Next Module - Model Evaluation](./04-Model%20Evaluation.ipynb)  \n",
        "> [⏪ Last Module - Data Prep and Feature Engineering](./02-Data%20Preparation%20and%20Feature%20Engineering.ipynb)  "
      ]
    }
  ],
  "metadata": {
    "kernelspec": {
      "display_name": ".NET (C#)",
      "language": "C#",
      "name": ".net-csharp"
    },
    "language_info": {
      "file_extension": ".cs",
      "mimetype": "text/x-csharp",
      "name": "C#",
      "pygments_lexer": "csharp",
      "version": "8.0"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 4
}