Middle name present in passport but not in other documents like academics, aadhar, pan. What to do?

Suppose my name on passport: vishal X Y

other documents(10, 12, college, pan): vishal Y

first name: vishal middle name: X last name: Y

fathers name in passport: X Y

Will a affidavit stating that both names are used by one person will be okay or should I change my name in some documents?