feat: nanoGPT implementation using Reactant

[avik-pal]

Needs

• NNlib.gather support in Reactant: feat: partial NNlib.gather support + better indexing support EnzymeAD/Reactant.jl#252
• NNlib.make_causal_mask: feat: add support for NNlib make causal mask EnzymeAD/Reactant.jl#249
• adjoint for dynamic_gather xref Jmp/scatter gather EnzymeAD/Enzyme-JAX#142

error: could not compute the adjoint for this operation %51 = "stablehlo.dynamic_gather"(%15, %0, %12) <{dimension_numbers = #stablehlo.gather<offset_dims = [0], collapsed_slice_dims = [1], start_index_map = [1], index_vector_dim = 1>}> : (tensor<64x64xf32>, tensor<64xi64>, tensor<2xi64>) -> tensor<64x64xf32>
error: could not compute the adjoint for this operation %47 = "stablehlo.dynamic_gather"(%14, %46, %12) <{dimension_numbers = #stablehlo.gather<offset_dims = [0], collapsed_slice_dims = [1], start_index_map = [1], index_vector_dim = 1>}> : (tensor<64x67xf32>, tensor<8192xi64>, tensor<2xi64>) -> tensor<64x8192xf32>
ERROR: LoadError: "failed to run pass manager on module"

[Copilot]

Copilot reviewed 3 out of 4 changed files in this pull request and generated no suggestions.

Files not reviewed (1)

• examples/NanoGPT/main.jl: Language not supported

[github-actions]

Benchmark Results (ASV)

	main	b508bb4...	main / b508bb4...
basics/overhead	0.135 ± 0.0013 μs	0.13 ± 0.0023 μs	1.04 ± 0.021
time_to_load	0.873 ± 0.0064 s	0.878 ± 0.0081 s	0.994 ± 0.012

Benchmark Plots

A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR.
Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).