Short Story ⟡ Informatics

Afternoon of Gathering Information

A story learning how to approach truth from incomplete information through Bayesian inference.

  • #bayesian inference
  • #posterior probability
  • #information gathering
  • #reasoning

"Is Aoi-senpai here?"

Yuki was searching the club room.

Riku answered. "Probably the library."

"Probably?"

"Senpai is always in the library at 3 PM."

Yuki became interested. "How did you know that?"

"Observation. Something called Bayesian inference?"

Aoi returned to the club room. "You called?"

"Riku said he did Bayesian inference of your location," Yuki explained.

"Interesting," Aoi laughed. "Correct application."

"What's Bayesian inference?" Yuki asked.

Aoi wrote an equation on the whiteboard.

"P(H|E) = P(E|H)P(H) / P(E)"

"Posterior probability is proportional to the product of likelihood and prior probability."

Riku explained. "In my case, I had prior knowledge that 'Aoi-senpai is always in the library.'"

"And obtained the evidence 'it's 3 PM now.'"

"So the posterior probability 'currently in the library' is high."

Yuki understood. "Gather information and update probability."

"Exactly. The essence of Bayesian inference is information accumulation."

Aoi drew a diagram.

"Prior probability: State without knowledge Observe evidence: New information Posterior probability: Updated belief"

"Repeat this cycle."

Yuki wrote in the notebook. "But what if the prior probability is wrong?"

"Good question," Aoi acknowledged. "If prior probability is significantly off, convergence is slow."

"But with sufficient evidence, it eventually approaches the correct value."

Riku gave an example. "Even if I believed 'Aoi-senpai is an alien'?"

"With evidence gathering, that hypothesis would be rejected," Aoi laughed.

"That's the power of information," Yuki said.

"Yes. Even starting with incomplete knowledge, observation can improve it."

Aoi gave another example.

"Rain in the morning. Do I need an umbrella today?"

"Prior probability: Past weather patterns Evidence: Current rain, cloud appearance Posterior probability: Probability rain continues all day"

Yuki understood. "The more information gathered, the better the prediction."

"Yes. Information theory and Bayesian inference are deeply related."

Riku thought. "Human relationships are also Bayesian inference?"

"Interesting perspective," Aoi nodded. "At first meeting, prior probability is vague. Gather evidence through conversation, infer the other's personality."

"That's why understanding deepens over time," Yuki was convinced.

"Misunderstanding is also inference based on insufficient evidence."

Aoi looked outside. "Perfect certainty can't be obtained. But gathering information reduces uncertainty."

Yuki asked. "How much information should we gather?"

"It's a tradeoff. Information gathering has costs."

Riku added. "Time, effort, risk."

"So set appropriate thresholds. When sufficiently confident, take action."

Yuki closed the notebook. "Bayesian inference can be used daily."

"We use it unconsciously," Aoi answered. "The human brain is a natural Bayesian estimator."

Riku laughed. "My brain has low estimation accuracy though."

"Can be improved with practice. Sharpen observation skills, increase prior knowledge."

Yuki said quietly. "The work of gathering information is fun."

"The pleasure of solving mysteries. The satisfaction of reducing uncertainty."

"That might be the essence of learning," Aoi smiled.

The three quietly left the classroom. Even starting with incomplete information, observation and reasoning bring us closer to truth.

The afternoon of gathering information continues.