Short Story ⟡ Informatics

The First Step Into the World of Information

A story exploring information theory overview, learning journey through the lens of information theory.

  • #information theory overview
  • #learning journey
  • #curiosity
  • #future applications

"By the way, when did I first come to the information theory club?"

Yuki asked nostalgically while flipping through their notebook.

"Three months ago," Aoi answered. "It was by chance."

"Chance... maybe," Yuki smiled. "That day, your notebook fell from the library shelf."

Riku laughed. "Yuki froze seeing incomprehensible words like entropy."

"Embarrassing! But somehow I was curious."

Mira quietly approached and opened her notebook. Yuki's first question remained there.

"Can information be measured?"

Aoi read aloud. "It was a good question."

"Now I can answer," Yuki said. "Information is the reduction of uncertainty. Measurable in bits."

"You've grown," Aoi said with deep feeling.

Riku sat by the window. "I also didn't understand what was interesting at first. Just equations."

"But now?"

"My view of the world changed. Probability, patterns, noise. Everything connects through information theory."

Mira wrote a note. "Information theory is a lens"

"A lens," Yuki translated. "Information theory is a lens for viewing the world."

Aoi nodded. "The theory Shannon built isn't just for communication. Biology, economics, psychology. It's used everywhere."

"Why is it applicable so broadly?" Yuki asked.

"Because the concept of information is fundamental," Aoi answered. "It's universal, on the same level as physical laws."

Riku asked. "What happens to information theory from now on?"

"Quantum information theory," Aoi said. "When quantum computers become practical, we'll need new information theory."

"Sounds difficult," Riku frowned.

"Current information theory was difficult at first too, right?" Aoi laughed.

Mira opened another page. Complex diagrams and notes.

"Fusion with machine learning," Aoi explained. "Much of deep learning can be explained by information theory principles."

"I want to learn more too," Yuki's eyes sparkled.

"Good attitude," Aoi said. "The journey in information theory has only just begun."

Riku jokingly asked. "So what do we learn next, professor?"

"I'm not a professor," Aoi smiled wryly. "Next, information transmission speed. Details of channel capacity maybe."

"Shannon limit!" Yuki exclaimed.

"Yes. Knowing theoretical limits lets you evaluate real-world technology."

Mira left a new note. "The journey of a thousand miles begins with a single bit"

"The journey of a thousand miles begins with a single bit," Riku translated.

"Good adaptation," Aoi acknowledged.

Yuki closed their notebook. "I thought it was difficult at first, but I feel like I'm gradually understanding."

"That's the learning process. Not rushing, but steadily."

Riku stood up. "But sometimes unpredictable actions are necessary too."

"That's high-entropy Riku," Aoi laughed.

Mira smiled. A little more expressive than usual.

"I'd be happy if Mira talked more," Yuki said.

Mira quietly nodded. And then, a final note.

"Communication is not just about speaking. It's about understanding."

"Communication is not just about speaking. It's about understanding."

Aoi opened the window. "Fresh wind coming in."

"New information?" Riku asked.

"Maybe. The world is always overflowing with new information."

Yuki took a deep breath. "The world of information is still so vast."

"Infinitely vast. But we can proceed step by step."

The four quietly held expectations for the next learning. The journey in information theory would continue.

Outside the window, wind swayed the leaves. Even in that seemingly random movement, there must be patterns.

"Now, let's take the next step," Aoi said.

"Yes!" Yuki and Riku answered.

Mira nodded silently. But her gaze was certainly looking toward the future.