|
Our cross-enzyme attention mechanism uses the formula: Attention equals softmax of query-key products divided by square root of d_k, plus learned bias terms B_i_j, times values. The key innovation is these bias terms which capture enzyme relationships. Our attention matrix shows strong diagonal values - 0.89 for CYP3A4, 0.87 for CYP2D6, 0.85 for CYP2C19 - representing enzyme-specific retrieval. Off-diagonal values of 0.41-0.46 enable 43-46% cross-enzyme knowledge sharing. This balances specificity with generalization through end-to-end training. |