Laws of Limits

The laws of limits are a set of fundamental rules that govern how limits of functions behave. These laws allow us to simplify and evaluate limits of more complex expressions. Understanding these laws is crucial for calculus, especially when calculating derivatives and integrals.

Here are the main laws of limits:

• 1. Limit of a Sum: The limit of the sum of two functions is the sum of their limits:

  \[ \lim_{x \to a} [f(x) + g(x)] = \lim_{x \to a} f(x) + \lim_{x \to a} g(x) \]

• 2. Limit of a Product: The limit of the product of two functions is the product of their limits:

  \[ \lim_{x \to a} [f(x) \cdot g(x)] = \lim_{x \to a} f(x) \cdot \lim_{x \to a} g(x) \]

• 3. Limit of a Constant Multiple: The limit of a constant multiplied by a function is the constant multiplied by the limit of the function:

  \[ \lim_{x \to a} [c \cdot f(x)] = c \cdot \lim_{x \to a} f(x) \]

• 4. Limit of a Quotient: The limit of the quotient of two functions (where the denominator's limit is not zero) is the quotient of their limits:

  \[ \lim_{x \to a} \frac{f(x)}{g(x)} = \frac{\lim_{x \to a} f(x)}{\lim_{x \to a} g(x)}, \quad \text{if} \quad \lim_{x \to a} g(x) \neq 0 \]

• 5. Limit of a Power: The limit of a function raised to a power is the limit of the function raised to that power:

  \[ \lim_{x \to a} [f(x)]^n = \left( \lim_{x \to a} f(x) \right)^n \]

• 6. Limit of a Root: The limit of the nth root of a function is the nth root of the limit of the function (for even roots, the function must be non-negative near the limit point):

  \[ \lim_{x \to a} \sqrt[n]{f(x)} = \sqrt[n]{\lim_{x \to a} f(x)} \]

Let’s evaluate the limit of the sum of two functions \( f(x) = 2x \) and \( g(x) = x^2 \) as \( x \to 1 \):

\[ \lim_{x \to 1} [2x + x^2] = \lim_{x \to 1} 2x + \lim_{x \to 1} x^2 = 2(1) + (1)^2 = 2 + 1 = 3 \]

The limit of the sum is the sum of the individual limits, which gives us 3.

Now, let’s evaluate the limit of the product of two functions \( f(x) = 3x \) and \( g(x) = x + 1 \) as \( x \to 2 \):

\[ \lim_{x \to 2} [3x \cdot (x + 1)] = \lim_{x \to 2} 3x \cdot \lim_{x \to 2} (x + 1) = 3(2) \cdot (2 + 1) = 6 \cdot 3 = 18 \]

The limit of the product is the product of the individual limits, which gives us 18.

Let’s evaluate the limit of the quotient \( f(x) = x^2 + 1 \) and \( g(x) = x - 1 \) as \( x \to 1 \):

\[ \lim_{x \to 1} \frac{x^2 + 1}{x - 1} = \frac{\lim_{x \to 1} (x^2 + 1)}{\lim_{x \to 1} (x - 1)} = \frac{1^2 + 1}{1 - 1} = \frac{2}{0} \]

Since the denominator approaches zero, the limit does not exist. This represents an asymptote at \( x = 1 \), indicating that the function grows without bound as \( x \) approaches 1.

Consider the learning rate in machine learning. When training a model, we adjust the learning rate to optimize the model's performance. The learning rate can be seen as a limit, where the algorithm approaches a point of convergence. If the learning rate is too large, the algorithm might overshoot the optimal solution, while if it’s too small, it may take too long to converge. Think of the behavior of the loss function as a function of the learning rate — how do the laws of limits apply here?

Try the following exercises to solidify your understanding of the laws of limits:

• 1. Evaluate the following limit using the laws of limits: \[ \lim_{x \to 3} [5x + 4] \]
• 2. Find the limit of the following product as \( x \to 2 \): \[ \lim_{x \to 2} [2x \cdot (x^2 - 1)] \]
• 3. Calculate the limit of the quotient: \[ \lim_{x \to 4} \frac{x^2 - 16}{x - 4} \]
• 4. What happens when the denominator in a quotient approaches zero? Illustrate with an example of your own, showing where the limit does not exist.

Think about how the concept of limits in optimization algorithms like gradient descent can help in the learning process of AI models. How can the application of limits and their laws help avoid issues like overshooting the optimal point in model training? How do the laws of limits influence the convergence behavior of such algorithms?

The laws of limits are fundamental rules in calculus that simplify the process of evaluating limits of complex expressions. Understanding how limits work, including the behavior of sums, products, quotients, and powers, is essential for studying functions and understanding their behavior. From physics and economics to machine learning and optimization, the application of limits is invaluable in analyzing how systems behave and converge.