Algebras – k-algebra and R-algebra – reconciling two definitions …

I am trying to get a full understanding of the notion of an algebra … I have thus consulted two books – Cohn: “Introduction to Ring Theory and…