Tag

activation function

0 views collected around this technical thread.

Model Perspective
Model Perspective
Aug 6, 2022 · Artificial Intelligence

Understanding Activation Functions in Artificial Neural Networks

This article introduces artificial neural networks, explains the role of artificial neurons and their weighted connections, and provides an overview of common activation functions—including linear, nonlinear ramp, threshold/step, and sigmoid forms—highlighting their characteristics and typical saturation values.

Deep LearningMachine Learningactivation function
0 likes · 2 min read
Understanding Activation Functions in Artificial Neural Networks
Python Programming Learning Circle
Python Programming Learning Circle
Mar 5, 2020 · Artificial Intelligence

Biological Neurons and Their Simple Mathematical Representation in Neural Networks

This article explains how biological neurons inspire artificial neural networks, describing neuron concepts, threshold firing, weighted inputs, bias, activation functions such as the step and sigmoid functions, and shows how these ideas are expressed mathematically and visualized with diagrams.

Artificial IntelligenceMachine Learningactivation function
0 likes · 13 min read
Biological Neurons and Their Simple Mathematical Representation in Neural Networks
Tencent Cloud Developer
Tencent Cloud Developer
Nov 9, 2018 · Artificial Intelligence

Demystifying Neural Networks: A Mathematical Approach

The article explains how basic mathematical principles—starting with simple predictors and linear classifiers, then extending to multi‑classifier systems, activation functions, and weight adjustments—underpin neural network architecture, illustrating each step with concrete examples to show how mathematics drives AI model training and performance.

XOR problemactivation functionbackpropagation
0 likes · 15 min read
Demystifying Neural Networks: A Mathematical Approach
Tencent Cloud Developer
Tencent Cloud Developer
Oct 15, 2018 · Artificial Intelligence

Neural Network Fundamentals: Building Your Own Neural Network from Scratch in Python

This tutorial explains neural network fundamentals by defining layers, weights, biases, and sigmoid activation, then walks through building a Python class that implements forward propagation, a sum‑of‑squared‑error loss, and backpropagation using the chain rule and gradient descent to train a simple two‑layer network.

Neural NetworkPythonactivation function
0 likes · 8 min read
Neural Network Fundamentals: Building Your Own Neural Network from Scratch in Python