Nov 28, 2021
Hi Aditya,
Please see the comments in the code. For your reference:
SEP token index: 8
#number of tokens in segment A (question) — this will be one more than the sep_idx as the index in Python starts from 0
Number of tokens in segment A: 9 (including the SEP token)
I hope this helps!