Differentiable simultaneous optimization of hyperparameters and neural network architecture. Also a [Neural Architecture Search](https://paperswithcode.com/method/neural-architecture-search) (NAS) method.

Bi-attention employs the attention-in-attention (AiA) mechanism to capture second-order statistical information: the outer point-wise channel attention vectors are computed from the output of the inner channel attention.

Bi-attention

Bilinear Attention Networks for Person Retrieval

Differentiable Hyperparameter Search

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

**TD-Gammon** is a game-learning architecture for playing backgammon. It involves the use of a $TD\left(\lambda\right)$ learning algorithm and a feedforward neural network.

Credit: [Temporal Difference Learning and
TD-Gammon](https://cling.csd.uwo.ca/cs346a/extra/tdgammon.pdf)

Source	sharpDARTS: Faster and More Accurate Differentiable Architecture Search
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com